2026-03-27 11:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 11:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 11:30:06 [auto1.be] INFO: Batch mode enabled: batch 1/2
2026-03-27 11:30:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-27 11:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 11:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 11:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 11:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 11:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 7662770fee084b51
2026-03-27 11:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 11:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_25_2026-03-27T11_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 11:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 11:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 11:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 11:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 11:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 11:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-27 11:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 11:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-27 11:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 11:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 11:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-27 11:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-27 11:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 11:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 11:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 11:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-27 11:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 11:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 11:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-27 11:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 11:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 11:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-27 11:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-27 11:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-27 11:30:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-27 11:30:22 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1863 | hits on page: 40
2026-03-27 11:30:22 [auto1.be] INFO: Found listing with ID: VZ41655
2026-03-27 11:30:22 [auto1.be] INFO: Found listing with ID: ME80219
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME80219%27 HTTP/1.1" 200 None
2026-03-27 11:30:22 [auto1.be] INFO: Scrape type for ME80219: 1
2026-03-27 11:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:22 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-27 11:30:22 [auto1.be] INFO: Scrape type for VT00410: 1
2026-03-27 11:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:22 [auto1.be] INFO: Found listing with ID: SA18446
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA18446%27 HTTP/1.1" 200 None
2026-03-27 11:30:22 [auto1.be] INFO: Scrape type for SA18446: 1
2026-03-27 11:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:22 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-27 11:30:22 [auto1.be] INFO: Scrape type for WG89987: 1
2026-03-27 11:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:22 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-27 11:30:22 [auto1.be] INFO: Scrape type for KE26750: 1
2026-03-27 11:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:22 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-27 11:30:22 [auto1.be] INFO: Found listing with ID: TY10971
2026-03-27 11:30:22 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-27 11:30:22 [auto1.be] INFO: Scrape type for ZM54310: 1
2026-03-27 11:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:22 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-27 11:30:22 [auto1.be] INFO: Scrape type for VP90118: 1
2026-03-27 11:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:22 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-27 11:30:22 [auto1.be] INFO: Scrape type for RW14221: 2
2026-03-27 11:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 532e3e3d-434a-58a8-92c5-32b9a70d214b with identifier: RW14221
2026-03-27 11:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 532e3e3d-434a-58a8-92c5-32b9a70d214b with scrape type 2
2026-03-27 11:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 532e3e3d-434a-58a8-92c5-32b9a70d214b with scrape type 2
2026-03-27 11:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 532e3e3d-434a-58a8-92c5-32b9a70d214b, identifier: RW14221
2026-03-27 11:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 532e3e3d-434a-58a8-92c5-32b9a70d214b with identifier: RW14221
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-27 11:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-27 11:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 532e3e3d-434a-58a8-92c5-32b9a70d214b with identifier: RW14221
2026-03-27 11:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 532e3e3d-434a-58a8-92c5-32b9a70d214b with identifier: RW14221 to the API
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:04Z',
 'fuel_type': 'petrol',
 'id': '532e3e3d-434a-58a8-92c5-32b9a70d214b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW14221',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 128746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-27 11:30:23 [auto1.be] INFO: Saving data for RW14221: {'auction_closing_time': 1774716544.0, 'created_time': 1773952768.31199, 'last_price_update_time': 1774611023.715621}
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW14221') HTTP/1.1" 204 0
2026-03-27 11:30:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:23 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-27 11:30:23 [auto1.be] INFO: Scrape type for VB04696: 2
2026-03-27 11:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1452a75b-4551-5745-b36a-48fe36f546f8 with identifier: VB04696
2026-03-27 11:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1452a75b-4551-5745-b36a-48fe36f546f8 with scrape type 2
2026-03-27 11:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1452a75b-4551-5745-b36a-48fe36f546f8 with scrape type 2
2026-03-27 11:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1452a75b-4551-5745-b36a-48fe36f546f8, identifier: VB04696
2026-03-27 11:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1452a75b-4551-5745-b36a-48fe36f546f8 with identifier: VB04696
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:30:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-27 11:30:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1452a75b-4551-5745-b36a-48fe36f546f8 with identifier: VB04696
2026-03-27 11:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1452a75b-4551-5745-b36a-48fe36f546f8 with identifier: VB04696 to the API
2026-03-27 11:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:07:01Z',
 'fuel_type': 'petrol',
 'id': '1452a75b-4551-5745-b36a-48fe36f546f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB04696',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 106180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-27 11:30:25 [auto1.be] INFO: Saving data for VB04696: {'auction_closing_time': 1774714021.0, 'created_time': 1773866643.764642, 'last_price_update_time': 1774611025.403986}
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VB04696') HTTP/1.1" 204 0
2026-03-27 11:30:25 [auto1.be] INFO: Found listing with ID: DB11071
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB11071%27 HTTP/1.1" 200 None
2026-03-27 11:30:25 [auto1.be] INFO: Scrape type for DB11071: 1
2026-03-27 11:30:25 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-27 11:30:25 [auto1.be] INFO: Scrape type for UA98228: 2
2026-03-27 11:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d4ae1a9-8910-597b-8128-538de3e6069c with identifier: UA98228
2026-03-27 11:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d4ae1a9-8910-597b-8128-538de3e6069c with scrape type 2
2026-03-27 11:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d4ae1a9-8910-597b-8128-538de3e6069c with scrape type 2
2026-03-27 11:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d4ae1a9-8910-597b-8128-538de3e6069c, identifier: UA98228
2026-03-27 11:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d4ae1a9-8910-597b-8128-538de3e6069c with identifier: UA98228
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-27 11:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-27 11:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d4ae1a9-8910-597b-8128-538de3e6069c with identifier: UA98228
2026-03-27 11:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d4ae1a9-8910-597b-8128-538de3e6069c with identifier: UA98228 to the API
2026-03-27 11:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:40:03Z',
 'fuel_type': 'diesel',
 'id': '9d4ae1a9-8910-597b-8128-538de3e6069c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA98228',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 160588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-01',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-27 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-27 11:30:26 [auto1.be] INFO: Saving data for UA98228: {'auction_closing_time': 1774716003.0, 'created_time': 1773833650.804224, 'last_price_update_time': 1774611026.287209}
2026-03-27 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA98228') HTTP/1.1" 204 0
2026-03-27 11:30:26 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-27 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-27 11:30:26 [auto1.be] INFO: Scrape type for WH33984: 2
2026-03-27 11:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with identifier: WH33984
2026-03-27 11:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with scrape type 2
2026-03-27 11:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with scrape type 2
2026-03-27 11:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8, identifier: WH33984
2026-03-27 11:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with identifier: WH33984
2026-03-27 11:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:30:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-27 11:30:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with identifier: WH33984
2026-03-27 11:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with identifier: WH33984 to the API
2026-03-27 11:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:06:17Z',
 'fuel_type': 'diesel',
 'id': '0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH33984',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 287672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-06',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi ECOnetic',
 'transmission': 'manual',
 'trim': 'ECOnetic',
 'year': 2010}
2026-03-27 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-27 11:30:27 [auto1.be] INFO: Saving data for WH33984: {'auction_closing_time': 1774713977.0, 'created_time': 1773909043.405104, 'last_price_update_time': 1774611027.511309}
2026-03-27 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH33984') HTTP/1.1" 204 0
2026-03-27 11:30:27 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-27 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-27 11:30:27 [auto1.be] INFO: Scrape type for DP96573: 1
2026-03-27 11:30:27 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-27 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD22160%27 HTTP/1.1" 200 None
2026-03-27 11:30:27 [auto1.be] INFO: Scrape type for BD22160: 2
2026-03-27 11:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07fa1a96-c02b-5f32-ad25-b54f089197a8 with identifier: BD22160
2026-03-27 11:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07fa1a96-c02b-5f32-ad25-b54f089197a8 with scrape type 2
2026-03-27 11:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07fa1a96-c02b-5f32-ad25-b54f089197a8 with scrape type 2
2026-03-27 11:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 07fa1a96-c02b-5f32-ad25-b54f089197a8, identifier: BD22160
2026-03-27 11:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 07fa1a96-c02b-5f32-ad25-b54f089197a8 with identifier: BD22160
2026-03-27 11:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:30:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-27 11:30:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 07fa1a96-c02b-5f32-ad25-b54f089197a8 with identifier: BD22160
2026-03-27 11:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 07fa1a96-c02b-5f32-ad25-b54f089197a8 with identifier: BD22160 to the API
2026-03-27 11:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:10:42Z',
 'fuel_type': 'hybrid',
 'id': '07fa1a96-c02b-5f32-ad25-b54f089197a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD22160',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 81628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-03',
 'seller_name': None,
 'title': 'Audi A7 Sportback 55 TFSIe quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD22160%27 HTTP/1.1" 200 None
2026-03-27 11:30:28 [auto1.be] INFO: Saving data for BD22160: {'auction_closing_time': 1774714242.0, 'created_time': 1774352261.344766, 'last_price_update_time': 1774611028.218585}
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BD22160') HTTP/1.1" 204 0
2026-03-27 11:30:28 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-27 11:30:28 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-27 11:30:28 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-27 11:30:28 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-27 11:30:28 [auto1.be] INFO: Found listing with ID: DL37030
2026-03-27 11:30:28 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-27 11:30:28 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-27 11:30:28 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-27 11:30:28 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-27 11:30:28 [auto1.be] INFO: Scrape type for KD31542: 2
2026-03-27 11:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b610291a-d6ec-5e07-83c5-c74f2366cddc with identifier: KD31542
2026-03-27 11:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b610291a-d6ec-5e07-83c5-c74f2366cddc with scrape type 2
2026-03-27 11:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b610291a-d6ec-5e07-83c5-c74f2366cddc with scrape type 2
2026-03-27 11:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b610291a-d6ec-5e07-83c5-c74f2366cddc, identifier: KD31542
2026-03-27 11:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b610291a-d6ec-5e07-83c5-c74f2366cddc with identifier: KD31542
2026-03-27 11:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b610291a-d6ec-5e07-83c5-c74f2366cddc with identifier: KD31542
2026-03-27 11:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b610291a-d6ec-5e07-83c5-c74f2366cddc with identifier: KD31542 to the API
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:41:49Z',
 'fuel_type': 'diesel',
 'id': 'b610291a-d6ec-5e07-83c5-c74f2366cddc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD31542',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 209678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-06',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2010}
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-27 11:30:28 [auto1.be] INFO: Saving data for KD31542: {'auction_closing_time': 1774716109.0, 'created_time': 1773747320.527256, 'last_price_update_time': 1774611028.687092}
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KD31542') HTTP/1.1" 204 0
2026-03-27 11:30:28 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-27 11:30:28 [auto1.be] INFO: Scrape type for LE55631: 1
2026-03-27 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE26750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA18446/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM54310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME80219/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG89987/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT00410/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP90118/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:28 [auto1.be] INFO: Found listing with ID: KB74591
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB74591%27 HTTP/1.1" 200 None
2026-03-27 11:30:28 [auto1.be] INFO: Scrape type for KB74591: 1
2026-03-27 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:28 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-27 11:30:28 [auto1.be] INFO: Scrape type for SZ60181: 1
2026-03-27 11:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:28 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-27 11:30:28 [auto1.be] INFO: Scrape type for PY12122: 2
2026-03-27 11:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45ffa21f-0452-5540-9c3b-b3e53e421a5d with identifier: PY12122
2026-03-27 11:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45ffa21f-0452-5540-9c3b-b3e53e421a5d with scrape type 2
2026-03-27 11:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45ffa21f-0452-5540-9c3b-b3e53e421a5d with scrape type 2
2026-03-27 11:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45ffa21f-0452-5540-9c3b-b3e53e421a5d, identifier: PY12122
2026-03-27 11:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45ffa21f-0452-5540-9c3b-b3e53e421a5d with identifier: PY12122
2026-03-27 11:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45ffa21f-0452-5540-9c3b-b3e53e421a5d with identifier: PY12122
2026-03-27 11:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45ffa21f-0452-5540-9c3b-b3e53e421a5d with identifier: PY12122 to the API
2026-03-27 11:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:07:27Z',
 'fuel_type': 'diesel',
 'id': '45ffa21f-0452-5540-9c3b-b3e53e421a5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY12122',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 125711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-14',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi GT L1',
 'transmission': 'manual',
 'trim': 'GT L1',
 'year': 2019}
2026-03-27 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-27 11:30:29 [auto1.be] INFO: Saving data for PY12122: {'auction_closing_time': 1774714047.0, 'created_time': 1773866527.193939, 'last_price_update_time': 1774611029.957081}
2026-03-27 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY12122') HTTP/1.1" 204 0
2026-03-27 11:30:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:29 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-27 11:30:29 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-27 11:30:29 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-27 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-27 11:30:29 [auto1.be] INFO: Scrape type for UW21644: 1
2026-03-27 11:30:30 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1863 | hits on page: 40
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-27 11:30:30 [auto1.be] INFO: Scrape type for SC85120: 1
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: VZ41655
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: ME80219
2026-03-27 11:30:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: BU79691
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-27 11:30:30 [auto1.be] INFO: Scrape type for MC44479: 1
2026-03-27 11:30:30 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/ME80219/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-27 11:30:30 [auto1.be] INFO: Scrape type for WH41445: 1
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: SA18446
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-27 11:30:30 [auto1.be] INFO: Scrape type for XC97675: 2
2026-03-27 11:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3c08361-dc63-50b9-9ce6-35e857cb8458 with identifier: XC97675
2026-03-27 11:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3c08361-dc63-50b9-9ce6-35e857cb8458 with scrape type 2
2026-03-27 11:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3c08361-dc63-50b9-9ce6-35e857cb8458 with scrape type 2
2026-03-27 11:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3c08361-dc63-50b9-9ce6-35e857cb8458, identifier: XC97675
2026-03-27 11:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3c08361-dc63-50b9-9ce6-35e857cb8458 with identifier: XC97675
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-27 11:30:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3c08361-dc63-50b9-9ce6-35e857cb8458 with identifier: XC97675
2026-03-27 11:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3c08361-dc63-50b9-9ce6-35e857cb8458 with identifier: XC97675 to the API
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:29:00Z',
 'fuel_type': 'petrol',
 'id': 'e3c08361-dc63-50b9-9ce6-35e857cb8458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC97675',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 60391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-27 11:30:30 [auto1.be] INFO: Saving data for XC97675: {'auction_closing_time': 1774715340.0, 'created_time': 1773909048.240341, 'last_price_update_time': 1774611030.693432}
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC97675') HTTP/1.1" 204 0
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: TY10971
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-27 11:30:30 [auto1.be] INFO: Scrape type for RW14221: 0
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-27 11:30:30 [auto1.be] INFO: Scrape type for VB04696: 0
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: DB11071
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-27 11:30:30 [auto1.be] INFO: Scrape type for UA98228: 0
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-27 11:30:30 [auto1.be] INFO: Scrape type for WH33984: 0
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD22160%27 HTTP/1.1" 200 None
2026-03-27 11:30:30 [auto1.be] INFO: Scrape type for BD22160: 0
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: DL37030
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-27 11:30:30 [auto1.be] INFO: Scrape type for KD31542: 0
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: KB74591
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-27 11:30:30 [auto1.be] INFO: Scrape type for PY12122: 0
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: BU79691
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-27 11:30:30 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-27 11:30:30 [auto1.be] INFO: Scrape type for XC97675: 0
2026-03-27 11:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB74591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB11071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LE55631/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SZ60181/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT00410> (referer: https://www.auto1.com/v1/car-details-view/VT00410/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec496ded-d4e0-525b-b85d-3e85669a7518 with identifier: VT00410
2026-03-27 11:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec496ded-d4e0-525b-b85d-3e85669a7518 with scrape type 1
2026-03-27 11:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ec496ded-d4e0-525b-b85d-3e85669a7518
2026-03-27 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F40%252Fbc408a2341608beaada87c5fc38abdcc%252Fpa%252FVT00410_efbfad88cf9d05f3a219ffb2bed8797d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_efbfad88cf9d05f3a219ffb2bed8797d.jpg not downloaded yet
2026-03-27 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F40%252Fbc408a2341608beaada87c5fc38abdcc%252Fpa%252FVT00410_9cf6ded16529a6eeb3a4d39564588f4f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_9cf6ded16529a6eeb3a4d39564588f4f.jpg not downloaded yet
2026-03-27 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F40%252Fbc408a2341608beaada87c5fc38abdcc%252Fpa%252FVT00410_02175d21894e01cedca2e987cc6f23f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_02175d21894e01cedca2e987cc6f23f8.jpg not downloaded yet
2026-03-27 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F40%252Fbc408a2341608beaada87c5fc38abdcc%252Fpa%252FVT00410_cd1f19a8f1319b52eec45a586e5f9beb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_cd1f19a8f1319b52eec45a586e5f9beb.jpg not downloaded yet
2026-03-27 11:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP96573/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F40%252Fbc408a2341608beaada87c5fc38abdcc%252Fpa%252FVT00410_fec38543342c221628d6d8b379e8d508.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_fec38543342c221628d6d8b379e8d508.jpg not downloaded yet
2026-03-27 11:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F40%252Fbc408a2341608beaada87c5fc38abdcc%252Fpa%252FVT00410_116bd7bfe11ad3ec6c169b49938f4c75.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_116bd7bfe11ad3ec6c169b49938f4c75.jpg not downloaded yet
2026-03-27 11:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP90118> (referer: https://www.auto1.com/v1/car-details-view/VP90118/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 804ce7e0-f7ca-5ca5-886f-e36716f80878 with identifier: VP90118
2026-03-27 11:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 804ce7e0-f7ca-5ca5-886f-e36716f80878 with scrape type 1
2026-03-27 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 804ce7e0-f7ca-5ca5-886f-e36716f80878
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F6a%252F776a6aa768565f536e97d87455cbb72c%252Fpa%252FVP90118_74170ba43c53dcfb438f3f23ae6c87eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_74170ba43c53dcfb438f3f23ae6c87eb.jpg already downloaded
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F6a%252F776a6aa768565f536e97d87455cbb72c%252Fpa%252FVP90118_6a208c1cc9a199f0d5b7c2f4b4cade86.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_6a208c1cc9a199f0d5b7c2f4b4cade86.jpg already downloaded
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F6a%252F776a6aa768565f536e97d87455cbb72c%252Fpa%252FVP90118_c259e5b07bab127d259e8954e8203dc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_c259e5b07bab127d259e8954e8203dc6.jpg already downloaded
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F6a%252F776a6aa768565f536e97d87455cbb72c%252Fpa%252FVP90118_143368e2913c58f4646b45bef954df5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_143368e2913c58f4646b45bef954df5a.jpg already downloaded
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F6a%252F776a6aa768565f536e97d87455cbb72c%252Fpa%252FVP90118_9d739121ffbd4dc23f7f5ae969f7836f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_9d739121ffbd4dc23f7f5ae969f7836f.jpg already downloaded
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F6a%252F776a6aa768565f536e97d87455cbb72c%252Fpa%252FVP90118_5b7eb0520bb207528543ac9b76f942d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_5b7eb0520bb207528543ac9b76f942d3.jpg already downloaded
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F6a%252F776a6aa768565f536e97d87455cbb72c%252Fpa%252FVP90118_8f59edf0ba352c5cd328586bc7e9606b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_8f59edf0ba352c5cd328586bc7e9606b.jpg already downloaded
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F6a%252F776a6aa768565f536e97d87455cbb72c%252Fpa%252FVP90118_57a0df6aa2c8f7bbe32022c8a2211cee.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_57a0df6aa2c8f7bbe32022c8a2211cee.jpg already downloaded
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F6a%252F776a6aa768565f536e97d87455cbb72c%252Fpa%252FVP90118_d54dc01bc32595789892b07366da6eba.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_d54dc01bc32595789892b07366da6eba.jpg already downloaded
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F6a%252F776a6aa768565f536e97d87455cbb72c%252Fpa%252FVP90118_8808265276c0b6792d6e8b38e0b59ecb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_8808265276c0b6792d6e8b38e0b59ecb.jpg already downloaded
2026-03-27 11:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 804ce7e0-f7ca-5ca5-886f-e36716f80878, identifier: VP90118
2026-03-27 11:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 804ce7e0-f7ca-5ca5-886f-e36716f80878 with identifier: VP90118
2026-03-27 11:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 804ce7e0-f7ca-5ca5-886f-e36716f80878 with identifier: VP90118
2026-03-27 11:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 804ce7e0-f7ca-5ca5-886f-e36716f80878 with identifier: VP90118 to the API
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VP90118>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:13:32Z',
 'fuel_type': 'petrol',
 'id': '804ce7e0-f7ca-5ca5-886f-e36716f80878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP90118',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 72102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_74170ba43c53dcfb438f3f23ae6c87eb.jpg',
                'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_6a208c1cc9a199f0d5b7c2f4b4cade86.jpg',
                'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_c259e5b07bab127d259e8954e8203dc6.jpg',
                'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_143368e2913c58f4646b45bef954df5a.jpg',
                'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_9d739121ffbd4dc23f7f5ae969f7836f.jpg',
                'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_5b7eb0520bb207528543ac9b76f942d3.jpg',
                'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_8f59edf0ba352c5cd328586bc7e9606b.jpg',
                'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_57a0df6aa2c8f7bbe32022c8a2211cee.jpg',
                'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_d54dc01bc32595789892b07366da6eba.jpg',
                'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_8808265276c0b6792d6e8b38e0b59ecb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804ce7e0-f7ca-5ca5-886f-e36716f80878/804ce7e0-f7ca-5ca5-886f-e36716f80878_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2750276,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_74170ba43c53dcfb438f3f23ae6c87eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804ce7e0-f7ca-5ca5-886f-e36716f80878/804ce7e0-f7ca-5ca5-886f-e36716f80878_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_6a208c1cc9a199f0d5b7c2f4b4cade86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804ce7e0-f7ca-5ca5-886f-e36716f80878/804ce7e0-f7ca-5ca5-886f-e36716f80878_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_c259e5b07bab127d259e8954e8203dc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804ce7e0-f7ca-5ca5-886f-e36716f80878/804ce7e0-f7ca-5ca5-886f-e36716f80878_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2516162,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_143368e2913c58f4646b45bef954df5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804ce7e0-f7ca-5ca5-886f-e36716f80878/804ce7e0-f7ca-5ca5-886f-e36716f80878_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_9d739121ffbd4dc23f7f5ae969f7836f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804ce7e0-f7ca-5ca5-886f-e36716f80878/804ce7e0-f7ca-5ca5-886f-e36716f80878_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_5b7eb0520bb207528543ac9b76f942d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804ce7e0-f7ca-5ca5-886f-e36716f80878/804ce7e0-f7ca-5ca5-886f-e36716f80878_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_8f59edf0ba352c5cd328586bc7e9606b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804ce7e0-f7ca-5ca5-886f-e36716f80878/804ce7e0-f7ca-5ca5-886f-e36716f80878_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_57a0df6aa2c8f7bbe32022c8a2211cee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804ce7e0-f7ca-5ca5-886f-e36716f80878/804ce7e0-f7ca-5ca5-886f-e36716f80878_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2524841,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_d54dc01bc32595789892b07366da6eba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804ce7e0-f7ca-5ca5-886f-e36716f80878/804ce7e0-f7ca-5ca5-886f-e36716f80878_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/6a/776a6aa768565f536e97d87455cbb72c/pa/VP90118_8808265276c0b6792d6e8b38e0b59ecb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-27 11:30:32 [auto1.be] INFO: Saving data for VP90118: {'created_time': 1774611032.761359, 'last_price_update_time': 1774611032.761371, 'auction_closing_time': 1774714412.0}
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP90118') HTTP/1.1" 204 0
2026-03-27 11:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_cd1f19a8f1319b52eec45a586e5f9beb.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM54310> (referer: https://www.auto1.com/v1/car-details-view/ZM54310/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG89987> (referer: https://www.auto1.com/v1/car-details-view/WG89987/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME80219> (referer: https://www.auto1.com/v1/car-details-view/ME80219/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA18446> (referer: https://www.auto1.com/v1/car-details-view/SA18446/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE26750> (referer: https://www.auto1.com/v1/car-details-view/KE26750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 11:30:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 11:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d2e790>
2026-03-27 11:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec496ded-d4e0-525b-b85d-3e85669a7518/ec496ded-d4e0-525b-b85d-3e85669a7518_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F40%252Fbc408a2341608beaada87c5fc38abdcc%252Fpa%252FVT00410_cd1f19a8f1319b52eec45a586e5f9beb.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_cd1f19a8f1319b52eec45a586e5f9beb.jpg saved to cache
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec496ded-d4e0-525b-b85d-3e85669a7518
2026-03-27 11:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_116bd7bfe11ad3ec6c169b49938f4c75.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f6523e0-a241-5558-8415-d2dc5206accb with identifier: ZM54310
2026-03-27 11:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f6523e0-a241-5558-8415-d2dc5206accb with scrape type 1
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6f6523e0-a241-5558-8415-d2dc5206accb
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F90%252F4090c477eec740b0e7fc2a0f25e637bb%252Fpa%252FZM54310_fe30b3cf644b7753c2170e8fca8a66b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_fe30b3cf644b7753c2170e8fca8a66b5.jpg not downloaded yet
2026-03-27 11:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64082240-6a27-58e4-8a93-93be97e7a50e with identifier: WG89987
2026-03-27 11:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64082240-6a27-58e4-8a93-93be97e7a50e with scrape type 1
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64082240-6a27-58e4-8a93-93be97e7a50e
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22677e3be6f9062d230b735c01a17395%252Fpa%252FWG89987_7720c74734ec7fc6dd6d7db760dd709f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_7720c74734ec7fc6dd6d7db760dd709f.jpg already downloaded
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22677e3be6f9062d230b735c01a17395%252Fpa%252FWG89987_7927f34123f05dade00eb64cec2ea151.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_7927f34123f05dade00eb64cec2ea151.jpg not downloaded yet
2026-03-27 11:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 764179fe-4ebf-5953-9878-9ec2c3b72eb1 with identifier: ME80219
2026-03-27 11:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1 with scrape type 1
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_c6ac9afd0929c6bb56f16ada18256c13.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_c6ac9afd0929c6bb56f16ada18256c13.jpg not downloaded yet
2026-03-27 11:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73d1b95e-fdf0-5668-8718-eb44fa9fe054 with identifier: SA18446
2026-03-27 11:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054 with scrape type 1
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_d7e61a5c710a42bff7a0a3088a564f2c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_d7e61a5c710a42bff7a0a3088a564f2c.jpg not downloaded yet
2026-03-27 11:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with identifier: KE26750
2026-03-27 11:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with scrape type 1
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F7a%252Ffe7a60594a9bca2dbce689f721f97f74%252Fpa%252FKE26750_0fd42a837b38ea9efb80bb5640e8d3b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_0fd42a837b38ea9efb80bb5640e8d3b7.jpg already downloaded
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F7a%252Ffe7a60594a9bca2dbce689f721f97f74%252Fpa%252FKE26750_84166efa01a3a9331dd44f94a8754781.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_84166efa01a3a9331dd44f94a8754781.jpg already downloaded
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F7a%252Ffe7a60594a9bca2dbce689f721f97f74%252Fpa%252FKE26750_9268c1ea6735697d411b4359f00a6ec0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_9268c1ea6735697d411b4359f00a6ec0.jpg already downloaded
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F7a%252Ffe7a60594a9bca2dbce689f721f97f74%252Fpa%252FKE26750_79ec398d7ea35f17c6fac52ae3f775b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_79ec398d7ea35f17c6fac52ae3f775b6.jpg already downloaded
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F7a%252Ffe7a60594a9bca2dbce689f721f97f74%252Fpa%252FKE26750_61c5ebfaf0e14fcccb28a9437590dc23.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_61c5ebfaf0e14fcccb28a9437590dc23.jpg already downloaded
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F7a%252Ffe7a60594a9bca2dbce689f721f97f74%252Fpa%252FKE26750_e13e7bab3a0a609b0d5efa2baccc88df.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_e13e7bab3a0a609b0d5efa2baccc88df.jpg already downloaded
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F7a%252Ffe7a60594a9bca2dbce689f721f97f74%252Fpa%252FKE26750_d2a0b33377fabd0e5121c73868fd20df.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_d2a0b33377fabd0e5121c73868fd20df.jpg already downloaded
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F7a%252Ffe7a60594a9bca2dbce689f721f97f74%252Fpa%252FKE26750_dc5c85b86c033a9fe68ce7cd859be733.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_dc5c85b86c033a9fe68ce7cd859be733.jpg already downloaded
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F7a%252Ffe7a60594a9bca2dbce689f721f97f74%252Fpa%252FKE26750_8d5be6b57c7ef717bcdd704f0d1c7df5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_8d5be6b57c7ef717bcdd704f0d1c7df5.jpg already downloaded
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F7a%252Ffe7a60594a9bca2dbce689f721f97f74%252Fpa%252FKE26750_bb62105dcd13050c0ba90893342dc5dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_bb62105dcd13050c0ba90893342dc5dc.jpg already downloaded
2026-03-27 11:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad, identifier: KE26750
2026-03-27 11:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with identifier: KE26750
2026-03-27 11:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with identifier: KE26750
2026-03-27 11:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with identifier: KE26750 to the API
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KE26750>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 83,
 'expiration_date': '2026-03-28T16:59:45Z',
 'fuel_type': 'petrol',
 'id': '351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE26750',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 36437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_0fd42a837b38ea9efb80bb5640e8d3b7.jpg',
                'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_84166efa01a3a9331dd44f94a8754781.jpg',
                'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_9268c1ea6735697d411b4359f00a6ec0.jpg',
                'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_79ec398d7ea35f17c6fac52ae3f775b6.jpg',
                'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_61c5ebfaf0e14fcccb28a9437590dc23.jpg',
                'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_e13e7bab3a0a609b0d5efa2baccc88df.jpg',
                'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_d2a0b33377fabd0e5121c73868fd20df.jpg',
                'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_dc5c85b86c033a9fe68ce7cd859be733.jpg',
                'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_8d5be6b57c7ef717bcdd704f0d1c7df5.jpg',
                'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_bb62105dcd13050c0ba90893342dc5dc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad/351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_0fd42a837b38ea9efb80bb5640e8d3b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad/351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_84166efa01a3a9331dd44f94a8754781.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad/351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_9268c1ea6735697d411b4359f00a6ec0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad/351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_79ec398d7ea35f17c6fac52ae3f775b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad/351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_61c5ebfaf0e14fcccb28a9437590dc23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad/351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_e13e7bab3a0a609b0d5efa2baccc88df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad/351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_d2a0b33377fabd0e5121c73868fd20df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad/351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_dc5c85b86c033a9fe68ce7cd859be733.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad/351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_8d5be6b57c7ef717bcdd704f0d1c7df5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad/351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/7a/fe7a60594a9bca2dbce689f721f97f74/pa/KE26750_bb62105dcd13050c0ba90893342dc5dc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2021}
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [auto1.be] INFO: Saving data for KE26750: {'created_time': 1774611034.023467, 'last_price_update_time': 1774611034.023477, 'auction_closing_time': 1774717185.0}
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KE26750') HTTP/1.1" 204 0
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F90%252F4090c477eec740b0e7fc2a0f25e637bb%252Fpa%252FZM54310_03fcf1e57c46f4cdb64238dbca233537.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_03fcf1e57c46f4cdb64238dbca233537.jpg not downloaded yet
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22677e3be6f9062d230b735c01a17395%252Fpa%252FWG89987_bce7ffba701ec22684ac8b682d75708e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_bce7ffba701ec22684ac8b682d75708e.jpg not downloaded yet
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_8cc1b1d6c90458c4e845aa29abbc2425.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_8cc1b1d6c90458c4e845aa29abbc2425.jpg not downloaded yet
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_b20db1e15482e1d754092cb5c8cb17e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_b20db1e15482e1d754092cb5c8cb17e5.jpg not downloaded yet
2026-03-27 11:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_02175d21894e01cedca2e987cc6f23f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_9cf6ded16529a6eeb3a4d39564588f4f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_fec38543342c221628d6d8b379e8d508.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC85120/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW21644/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F90%252F4090c477eec740b0e7fc2a0f25e637bb%252Fpa%252FZM54310_f514b1d3fd775c9ad891b3d5f9649a33.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_f514b1d3fd775c9ad891b3d5f9649a33.jpg not downloaded yet
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22677e3be6f9062d230b735c01a17395%252Fpa%252FWG89987_421b9f88524a69e8f623ba12018e7e25.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_421b9f88524a69e8f623ba12018e7e25.jpg already downloaded
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22677e3be6f9062d230b735c01a17395%252Fpa%252FWG89987_21a0aa750a94051a53c697ea652983f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_21a0aa750a94051a53c697ea652983f5.jpg already downloaded
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22677e3be6f9062d230b735c01a17395%252Fpa%252FWG89987_3c1361edafa3280320ffd8a8d4cce00c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_3c1361edafa3280320ffd8a8d4cce00c.jpg already downloaded
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22677e3be6f9062d230b735c01a17395%252Fpa%252FWG89987_a67d11d52760badd544e81afd575c366.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_a67d11d52760badd544e81afd575c366.jpg already downloaded
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22677e3be6f9062d230b735c01a17395%252Fpa%252FWG89987_37d7d9b794af6ad3c1beb9ec6e18c5ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_37d7d9b794af6ad3c1beb9ec6e18c5ed.jpg already downloaded
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22677e3be6f9062d230b735c01a17395%252Fpa%252FWG89987_7a5243dec9456ce84be22a33454e4007.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_7a5243dec9456ce84be22a33454e4007.jpg already downloaded
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22677e3be6f9062d230b735c01a17395%252Fpa%252FWG89987_964dd40f3084f0fdfe55379c7739b116.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_964dd40f3084f0fdfe55379c7739b116.jpg already downloaded
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_eae761e5fddf86c2b1a1ad4aad1512b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_eae761e5fddf86c2b1a1ad4aad1512b8.jpg not downloaded yet
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_64d2bd015a0d4bab33d72257db8156ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_64d2bd015a0d4bab33d72257db8156ae.jpg not downloaded yet
2026-03-27 11:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0f367d0>
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec496ded-d4e0-525b-b85d-3e85669a7518/ec496ded-d4e0-525b-b85d-3e85669a7518_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F40%252Fbc408a2341608beaada87c5fc38abdcc%252Fpa%252FVT00410_116bd7bfe11ad3ec6c169b49938f4c75.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_116bd7bfe11ad3ec6c169b49938f4c75.jpg saved to cache
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec496ded-d4e0-525b-b85d-3e85669a7518
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F90%252F4090c477eec740b0e7fc2a0f25e637bb%252Fpa%252FZM54310_73829b0ae7e81eb71b55ed860750d972.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_73829b0ae7e81eb71b55ed860750d972.jpg not downloaded yet
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_41c40ab9e605b82f9da6ef02dba58974.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_41c40ab9e605b82f9da6ef02dba58974.jpg not downloaded yet
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_a028b00a3e3087a03500a60d064e0139.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_a028b00a3e3087a03500a60d064e0139.jpg not downloaded yet
2026-03-27 11:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_efbfad88cf9d05f3a219ffb2bed8797d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0f353d0>
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec496ded-d4e0-525b-b85d-3e85669a7518/ec496ded-d4e0-525b-b85d-3e85669a7518_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F40%252Fbc408a2341608beaada87c5fc38abdcc%252Fpa%252FVT00410_02175d21894e01cedca2e987cc6f23f8.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_02175d21894e01cedca2e987cc6f23f8.jpg saved to cache
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec496ded-d4e0-525b-b85d-3e85669a7518
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0bd8d10>
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec496ded-d4e0-525b-b85d-3e85669a7518/ec496ded-d4e0-525b-b85d-3e85669a7518_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F40%252Fbc408a2341608beaada87c5fc38abdcc%252Fpa%252FVT00410_9cf6ded16529a6eeb3a4d39564588f4f.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_9cf6ded16529a6eeb3a4d39564588f4f.jpg saved to cache
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec496ded-d4e0-525b-b85d-3e85669a7518
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0f19cd0>
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec496ded-d4e0-525b-b85d-3e85669a7518/ec496ded-d4e0-525b-b85d-3e85669a7518_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F40%252Fbc408a2341608beaada87c5fc38abdcc%252Fpa%252FVT00410_fec38543342c221628d6d8b379e8d508.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_fec38543342c221628d6d8b379e8d508.jpg saved to cache
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec496ded-d4e0-525b-b85d-3e85669a7518
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F90%252F4090c477eec740b0e7fc2a0f25e637bb%252Fpa%252FZM54310_7928e053f4b2433b970472920c1b558a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_7928e053f4b2433b970472920c1b558a.jpg not downloaded yet
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_66f221bcf3490859ba6979260b2fcfaa.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_66f221bcf3490859ba6979260b2fcfaa.jpg not downloaded yet
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_91e56fbbd85091cc83bf9d341a3fcab1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_91e56fbbd85091cc83bf9d341a3fcab1.jpg not downloaded yet
2026-03-27 11:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_fe30b3cf644b7753c2170e8fca8a66b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_7927f34123f05dade00eb64cec2ea151.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_4d0c218299e319546d49880d063a566c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_4d0c218299e319546d49880d063a566c.jpg not downloaded yet
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_bfff3cef2e60a05d88bde1192edb564a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_bfff3cef2e60a05d88bde1192edb564a.jpg not downloaded yet
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c72c10>
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec496ded-d4e0-525b-b85d-3e85669a7518/ec496ded-d4e0-525b-b85d-3e85669a7518_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F40%252Fbc408a2341608beaada87c5fc38abdcc%252Fpa%252FVT00410_efbfad88cf9d05f3a219ffb2bed8797d.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_efbfad88cf9d05f3a219ffb2bed8797d.jpg saved to cache
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec496ded-d4e0-525b-b85d-3e85669a7518
2026-03-27 11:30:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec496ded-d4e0-525b-b85d-3e85669a7518, skipping ID generation
2026-03-27 11:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec496ded-d4e0-525b-b85d-3e85669a7518 with scrape type 1
2026-03-27 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec496ded-d4e0-525b-b85d-3e85669a7518 sending to next pipeline
2026-03-27 11:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec496ded-d4e0-525b-b85d-3e85669a7518, identifier: VT00410
2026-03-27 11:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MC44479/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec496ded-d4e0-525b-b85d-3e85669a7518 with identifier: VT00410
2026-03-27 11:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec496ded-d4e0-525b-b85d-3e85669a7518 with identifier: VT00410
2026-03-27 11:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec496ded-d4e0-525b-b85d-3e85669a7518 with identifier: VT00410 to the API
2026-03-27 11:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_efbfad88cf9d05f3a219ffb2bed8797d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:39:48Z',
 'fuel_type': 'petrol',
 'id': 'ec496ded-d4e0-525b-b85d-3e85669a7518',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT00410',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 95103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec496ded-d4e0-525b-b85d-3e85669a7518/ec496ded-d4e0-525b-b85d-3e85669a7518_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_efbfad88cf9d05f3a219ffb2bed8797d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec496ded-d4e0-525b-b85d-3e85669a7518/ec496ded-d4e0-525b-b85d-3e85669a7518_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_9cf6ded16529a6eeb3a4d39564588f4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec496ded-d4e0-525b-b85d-3e85669a7518/ec496ded-d4e0-525b-b85d-3e85669a7518_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_02175d21894e01cedca2e987cc6f23f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec496ded-d4e0-525b-b85d-3e85669a7518/ec496ded-d4e0-525b-b85d-3e85669a7518_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_cd1f19a8f1319b52eec45a586e5f9beb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec496ded-d4e0-525b-b85d-3e85669a7518/ec496ded-d4e0-525b-b85d-3e85669a7518_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_fec38543342c221628d6d8b379e8d508.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec496ded-d4e0-525b-b85d-3e85669a7518/ec496ded-d4e0-525b-b85d-3e85669a7518_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/40/bc408a2341608beaada87c5fc38abdcc/pa/VT00410_116bd7bfe11ad3ec6c169b49938f4c75.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Futura',
 'transmission': 'manual',
 'trim': 'Futura',
 'year': 2005}
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [auto1.be] INFO: Saving data for VT00410: {'created_time': 1774611035.23839, 'last_price_update_time': 1774611035.238402, 'auction_closing_time': 1774715988.0}
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VT00410') HTTP/1.1" 204 0
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_ca70524f9d774d097e534ce286773171.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_ca70524f9d774d097e534ce286773171.jpg not downloaded yet
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_8e4cd8a16cca9e813c6150bbffe8123a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_8e4cd8a16cca9e813c6150bbffe8123a.jpg not downloaded yet
2026-03-27 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH41445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0ca51d0>
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f6523e0-a241-5558-8415-d2dc5206accb/6f6523e0-a241-5558-8415-d2dc5206accb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F90%252F4090c477eec740b0e7fc2a0f25e637bb%252Fpa%252FZM54310_fe30b3cf644b7753c2170e8fca8a66b5.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_fe30b3cf644b7753c2170e8fca8a66b5.jpg saved to cache
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f6523e0-a241-5558-8415-d2dc5206accb
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c71e90>
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64082240-6a27-58e4-8a93-93be97e7a50e/64082240-6a27-58e4-8a93-93be97e7a50e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22677e3be6f9062d230b735c01a17395%252Fpa%252FWG89987_7927f34123f05dade00eb64cec2ea151.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_7927f34123f05dade00eb64cec2ea151.jpg saved to cache
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64082240-6a27-58e4-8a93-93be97e7a50e
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_f5272e6085306c9742a6a9962d86d06c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_f5272e6085306c9742a6a9962d86d06c.jpg not downloaded yet
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_9b8da8516a8275d7557f0a2697cdcd68.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_9b8da8516a8275d7557f0a2697cdcd68.jpg not downloaded yet
2026-03-27 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LE55631> (referer: https://www.auto1.com/v1/car-details-view/LE55631/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB11071> (referer: https://www.auto1.com/v1/car-details-view/DB11071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB74591> (referer: https://www.auto1.com/v1/car-details-view/KB74591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_08b92fa9a71a1908f3f5ed8d8a04fc73.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_08b92fa9a71a1908f3f5ed8d8a04fc73.jpg not downloaded yet
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_86bf63fa08d7a7c38e656a9607a28d8f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_86bf63fa08d7a7c38e656a9607a28d8f.jpg not downloaded yet
2026-03-27 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_66f221bcf3490859ba6979260b2fcfaa.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_ce2d4f2295f13db566e54fa2c2a62052.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_ce2d4f2295f13db566e54fa2c2a62052.jpg not downloaded yet
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_da44f95ba831edf62317ab90294156ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_da44f95ba831edf62317ab90294156ed.jpg not downloaded yet
2026-03-27 11:30:35 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1863 | hits on page: 40
2026-03-27 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_91e56fbbd85091cc83bf9d341a3fcab1.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:35 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [auto1.be] INFO: Scrape type for JS91211: 1
2026-03-27 11:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:35 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [auto1.be] INFO: Scrape type for XT90325: 1
2026-03-27 11:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8013032f-390a-5eea-966f-854d34707c70 with identifier: LE55631
2026-03-27 11:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8013032f-390a-5eea-966f-854d34707c70 with scrape type 1
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8013032f-390a-5eea-966f-854d34707c70
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_ae4b13e9d0e75ee10b27c14cbbbeb03a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_ae4b13e9d0e75ee10b27c14cbbbeb03a.jpg not downloaded yet
2026-03-27 11:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a9378dd-2203-5033-8a48-292148cd8edf with identifier: DB11071
2026-03-27 11:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9378dd-2203-5033-8a48-292148cd8edf with scrape type 1
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a9378dd-2203-5033-8a48-292148cd8edf
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_311903462814993c49ea7113b49e92e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_311903462814993c49ea7113b49e92e0.jpg not downloaded yet
2026-03-27 11:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f620c6db-e201-522a-a54b-ed85a09b2f43 with identifier: KB74591
2026-03-27 11:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f620c6db-e201-522a-a54b-ed85a09b2f43 with scrape type 1
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f620c6db-e201-522a-a54b-ed85a09b2f43
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_fdacb2de22a0e6533a627659beffdb2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_fdacb2de22a0e6533a627659beffdb2f.jpg not downloaded yet
2026-03-27 11:30:35 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [auto1.be] INFO: Scrape type for ZK00678: 1
2026-03-27 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_8cc1b1d6c90458c4e845aa29abbc2425.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_bce7ffba701ec22684ac8b682d75708e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_f2ccf2abb62282daf49d430d1a8ee985.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_f2ccf2abb62282daf49d430d1a8ee985.jpg not downloaded yet
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_872f614272969b6884fa6442d7ab6615.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_872f614272969b6884fa6442d7ab6615.jpg not downloaded yet
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_4f89fa664723f75ea0b88e83a984e4a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_4f89fa664723f75ea0b88e83a984e4a1.jpg not downloaded yet
2026-03-27 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_bfff3cef2e60a05d88bde1192edb564a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:35 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-27 11:30:35 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [auto1.be] INFO: Scrape type for ED59297: 1
2026-03-27 11:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d15850>
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_66f221bcf3490859ba6979260b2fcfaa.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_66f221bcf3490859ba6979260b2fcfaa.jpg saved to cache
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0f2f9d0>
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_91e56fbbd85091cc83bf9d341a3fcab1.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_91e56fbbd85091cc83bf9d341a3fcab1.jpg saved to cache
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054
2026-03-27 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_4d0c218299e319546d49880d063a566c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_33b058fdbfd3eb6ed3865b48a04d23bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_33b058fdbfd3eb6ed3865b48a04d23bf.jpg not downloaded yet
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_81c949182b0097b0091eb08db770b9dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_81c949182b0097b0091eb08db770b9dd.jpg not downloaded yet
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_4607038a7d9eba460b37ef6833646e04.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_4607038a7d9eba460b37ef6833646e04.jpg not downloaded yet
2026-03-27 11:30:35 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-27 11:30:35 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-27 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-27 11:30:36 [auto1.be] INFO: Scrape type for WD60187: 2
2026-03-27 11:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d20b14f-7890-5077-89b1-e5edd3895e73 with identifier: WD60187
2026-03-27 11:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d20b14f-7890-5077-89b1-e5edd3895e73 with scrape type 2
2026-03-27 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d20b14f-7890-5077-89b1-e5edd3895e73 with scrape type 2
2026-03-27 11:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d20b14f-7890-5077-89b1-e5edd3895e73, identifier: WD60187
2026-03-27 11:30:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d20b14f-7890-5077-89b1-e5edd3895e73 with identifier: WD60187
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-27 11:30:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d20b14f-7890-5077-89b1-e5edd3895e73 with identifier: WD60187
2026-03-27 11:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d20b14f-7890-5077-89b1-e5edd3895e73 with identifier: WD60187 to the API
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:18:55Z',
 'fuel_type': 'diesel',
 'id': '6d20b14f-7890-5077-89b1-e5edd3895e73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD60187',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 269111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-30',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
 'transmission': 'automatic',
 'trim': 'Overland',
 'year': 2014}
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-27 11:30:36 [auto1.be] INFO: Saving data for WD60187: {'auction_closing_time': 1774714735.0, 'created_time': 1773301772.752533, 'last_price_update_time': 1774611036.646965}
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WD60187') HTTP/1.1" 204 0
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_ac150ff4d0a3fdbdc0c5fd30cee46ed8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_ac150ff4d0a3fdbdc0c5fd30cee46ed8.jpg not downloaded yet
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_87dbf8a5d703b5d0d90ba1826acab3d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_87dbf8a5d703b5d0d90ba1826acab3d8.jpg not downloaded yet
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_f3b3def6d3cb70bc345389a1d7db5222.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_f3b3def6d3cb70bc345389a1d7db5222.jpg not downloaded yet
2026-03-27 11:30:36 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-27 11:30:36 [auto1.be] INFO: Scrape type for CC17071: 1
2026-03-27 11:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_7928e053f4b2433b970472920c1b558a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_8e4cd8a16cca9e813c6150bbffe8123a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_ca70524f9d774d097e534ce286773171.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_626b4e7ca746610f1c717c7947eede05.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_626b4e7ca746610f1c717c7947eede05.jpg not downloaded yet
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_b7bc11083250625e1a9cad2c8b475067.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_b7bc11083250625e1a9cad2c8b475067.jpg not downloaded yet
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_3fae8620b44e842ecbd859b67529d749.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_3fae8620b44e842ecbd859b67529d749.jpg not downloaded yet
2026-03-27 11:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW21644> (referer: https://www.auto1.com/v1/car-details-view/UW21644/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0be19d0>
2026-03-27 11:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_8cc1b1d6c90458c4e845aa29abbc2425.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_8cc1b1d6c90458c4e845aa29abbc2425.jpg saved to cache
2026-03-27 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1
2026-03-27 11:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b026d0>
2026-03-27 11:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64082240-6a27-58e4-8a93-93be97e7a50e/64082240-6a27-58e4-8a93-93be97e7a50e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F67%252F22677e3be6f9062d230b735c01a17395%252Fpa%252FWG89987_bce7ffba701ec22684ac8b682d75708e.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_bce7ffba701ec22684ac8b682d75708e.jpg saved to cache
2026-03-27 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64082240-6a27-58e4-8a93-93be97e7a50e
2026-03-27 11:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64082240-6a27-58e4-8a93-93be97e7a50e, skipping ID generation
2026-03-27 11:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64082240-6a27-58e4-8a93-93be97e7a50e with scrape type 1
2026-03-27 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64082240-6a27-58e4-8a93-93be97e7a50e sending to next pipeline
2026-03-27 11:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64082240-6a27-58e4-8a93-93be97e7a50e, identifier: WG89987
2026-03-27 11:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a69f10>
2026-03-27 11:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_bfff3cef2e60a05d88bde1192edb564a.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_bfff3cef2e60a05d88bde1192edb564a.jpg saved to cache
2026-03-27 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054
2026-03-27 11:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0afe210>
2026-03-27 11:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_4d0c218299e319546d49880d063a566c.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_4d0c218299e319546d49880d063a566c.jpg saved to cache
2026-03-27 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1
2026-03-27 11:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_86bf63fa08d7a7c38e656a9607a28d8f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:37 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-27 11:30:37 [auto1.be] INFO: Scrape type for EP09858: 1
2026-03-27 11:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SZ60181> (referer: https://www.auto1.com/v1/car-details-view/SZ60181/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP96573> (referer: https://www.auto1.com/v1/car-details-view/DP96573/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64082240-6a27-58e4-8a93-93be97e7a50e with identifier: WG89987
2026-03-27 11:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64082240-6a27-58e4-8a93-93be97e7a50e with identifier: WG89987
2026-03-27 11:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64082240-6a27-58e4-8a93-93be97e7a50e with identifier: WG89987 to the API
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_bce7ffba701ec22684ac8b682d75708e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:15:45Z',
 'fuel_type': 'diesel',
 'id': '64082240-6a27-58e4-8a93-93be97e7a50e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG89987',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '5er',
 'odometer': 221145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64082240-6a27-58e4-8a93-93be97e7a50e/64082240-6a27-58e4-8a93-93be97e7a50e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2774820,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_7720c74734ec7fc6dd6d7db760dd709f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64082240-6a27-58e4-8a93-93be97e7a50e/64082240-6a27-58e4-8a93-93be97e7a50e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_7927f34123f05dade00eb64cec2ea151.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64082240-6a27-58e4-8a93-93be97e7a50e/64082240-6a27-58e4-8a93-93be97e7a50e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_bce7ffba701ec22684ac8b682d75708e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64082240-6a27-58e4-8a93-93be97e7a50e/64082240-6a27-58e4-8a93-93be97e7a50e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_421b9f88524a69e8f623ba12018e7e25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64082240-6a27-58e4-8a93-93be97e7a50e/64082240-6a27-58e4-8a93-93be97e7a50e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2621813,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_21a0aa750a94051a53c697ea652983f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64082240-6a27-58e4-8a93-93be97e7a50e/64082240-6a27-58e4-8a93-93be97e7a50e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_3c1361edafa3280320ffd8a8d4cce00c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64082240-6a27-58e4-8a93-93be97e7a50e/64082240-6a27-58e4-8a93-93be97e7a50e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2625430,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_a67d11d52760badd544e81afd575c366.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64082240-6a27-58e4-8a93-93be97e7a50e/64082240-6a27-58e4-8a93-93be97e7a50e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2607911,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_37d7d9b794af6ad3c1beb9ec6e18c5ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64082240-6a27-58e4-8a93-93be97e7a50e/64082240-6a27-58e4-8a93-93be97e7a50e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_7a5243dec9456ce84be22a33454e4007.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64082240-6a27-58e4-8a93-93be97e7a50e/64082240-6a27-58e4-8a93-93be97e7a50e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/67/22677e3be6f9062d230b735c01a17395/pa/WG89987_964dd40f3084f0fdfe55379c7739b116.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-27 11:30:37 [auto1.be] INFO: Saving data for WG89987: {'created_time': 1774611037.863469, 'last_price_update_time': 1774611037.863481, 'auction_closing_time': 1774714545.0}
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG89987') HTTP/1.1" 204 0
2026-03-27 11:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_416e32a10a2e6712d205513955f709fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_416e32a10a2e6712d205513955f709fc.jpg not downloaded yet
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_cc352601268d5ff2e5e29380e45bae79.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_cc352601268d5ff2e5e29380e45bae79.jpg not downloaded yet
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_dc4b6901a6b6dce5e87e982eb4dae1b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_dc4b6901a6b6dce5e87e982eb4dae1b7.jpg not downloaded yet
2026-03-27 11:30:37 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-27 11:30:37 [auto1.be] INFO: Scrape type for MF96479: 2
2026-03-27 11:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with identifier: MF96479
2026-03-27 11:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with scrape type 2
2026-03-27 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with scrape type 2
2026-03-27 11:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c6c0b4d-256b-588f-9919-5a2e28640ae5, identifier: MF96479
2026-03-27 11:30:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b03bd0>
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f6523e0-a241-5558-8415-d2dc5206accb/6f6523e0-a241-5558-8415-d2dc5206accb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F90%252F4090c477eec740b0e7fc2a0f25e637bb%252Fpa%252FZM54310_7928e053f4b2433b970472920c1b558a.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_7928e053f4b2433b970472920c1b558a.jpg saved to cache
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f6523e0-a241-5558-8415-d2dc5206accb
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d15410>
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_8e4cd8a16cca9e813c6150bbffe8123a.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_8e4cd8a16cca9e813c6150bbffe8123a.jpg saved to cache
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0ac0e10>
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_ca70524f9d774d097e534ce286773171.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_ca70524f9d774d097e534ce286773171.jpg saved to cache
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1
2026-03-27 11:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d85aef54-640f-5d98-9b99-1c2927a173a1 with identifier: UW21644
2026-03-27 11:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85aef54-640f-5d98-9b99-1c2927a173a1 with scrape type 1
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d85aef54-640f-5d98-9b99-1c2927a173a1
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fdd%252F50dd562347c04050e0e680a0e32998db%252Fpa%252FUW21644_248a482c6495128bc281dc4e13aa9cd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_248a482c6495128bc281dc4e13aa9cd5.jpg not downloaded yet
2026-03-27 11:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_f3b3def6d3cb70bc345389a1d7db5222.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_fdacb2de22a0e6533a627659beffdb2f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_311903462814993c49ea7113b49e92e0.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with identifier: MF96479
2026-03-27 11:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with identifier: MF96479
2026-03-27 11:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with identifier: MF96479 to the API
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:56Z',
 'fuel_type': 'diesel',
 'id': '2c6c0b4d-256b-588f-9919-5a2e28640ae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF96479',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 153674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-02',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [auto1.be] INFO: Saving data for MF96479: {'auction_closing_time': 1774714736.0, 'created_time': 1773909040.513067, 'last_price_update_time': 1774611038.592724}
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MF96479') HTTP/1.1" 204 0
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_8a44e9a6a7e62bb38ef9b35c098dd642.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_8a44e9a6a7e62bb38ef9b35c098dd642.jpg not downloaded yet
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_aafde6b16cf9c3af0f773b35432927dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_aafde6b16cf9c3af0f773b35432927dc.jpg not downloaded yet
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_45622b50c8ac1abbde346e5d4f5298cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_45622b50c8ac1abbde346e5d4f5298cb.jpg not downloaded yet
2026-03-27 11:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH41445> (referer: https://www.auto1.com/v1/car-details-view/WH41445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:38 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [auto1.be] INFO: Scrape type for KA88762: 1
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fdd%252F50dd562347c04050e0e680a0e32998db%252Fpa%252FUW21644_4d4ac06cf6afb9c0604ef2b15fcb3e32.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_4d4ac06cf6afb9c0604ef2b15fcb3e32.jpg not downloaded yet
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b36e90>
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_86bf63fa08d7a7c38e656a9607a28d8f.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_86bf63fa08d7a7c38e656a9607a28d8f.jpg saved to cache
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054
2026-03-27 11:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with identifier: SZ60181
2026-03-27 11:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with scrape type 1
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_eaf3b4241e7af4502575745b001a5a57.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_eaf3b4241e7af4502575745b001a5a57.jpg not downloaded yet
2026-03-27 11:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bcbf188-681f-5ef8-915a-1befaf5e4bff with identifier: DP96573
2026-03-27 11:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bcbf188-681f-5ef8-915a-1befaf5e4bff with scrape type 1
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3bcbf188-681f-5ef8-915a-1befaf5e4bff
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fcd%252F14cd641af35ef56e8b1f52507b54b90a%252Fpa%252FDP96573_b98ab1e4ca56314102fe039d22c5c337.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_b98ab1e4ca56314102fe039d22c5c337.jpg already downloaded
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fcd%252F14cd641af35ef56e8b1f52507b54b90a%252Fpa%252FDP96573_a2a6eb28d294a770204ffcb69f731bc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_a2a6eb28d294a770204ffcb69f731bc6.jpg already downloaded
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fcd%252F14cd641af35ef56e8b1f52507b54b90a%252Fpa%252FDP96573_f0a0e1f6dc89e772101eed609f90ef5d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_f0a0e1f6dc89e772101eed609f90ef5d.jpg already downloaded
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fcd%252F14cd641af35ef56e8b1f52507b54b90a%252Fpa%252FDP96573_7b770158349edb45b42e3a7f37768491.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_7b770158349edb45b42e3a7f37768491.jpg already downloaded
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fcd%252F14cd641af35ef56e8b1f52507b54b90a%252Fpa%252FDP96573_1aeae790ac7f05ef436224df8e7fafa0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_1aeae790ac7f05ef436224df8e7fafa0.jpg already downloaded
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fcd%252F14cd641af35ef56e8b1f52507b54b90a%252Fpa%252FDP96573_cfdfdaf03e8e822e5d47c1304b06cf98.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_cfdfdaf03e8e822e5d47c1304b06cf98.jpg already downloaded
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fcd%252F14cd641af35ef56e8b1f52507b54b90a%252Fpa%252FDP96573_d41591f170fdab3c57a02998e16db074.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_d41591f170fdab3c57a02998e16db074.jpg already downloaded
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fcd%252F14cd641af35ef56e8b1f52507b54b90a%252Fpa%252FDP96573_795f1744205c2de383a622a107544a2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_795f1744205c2de383a622a107544a2e.jpg already downloaded
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fcd%252F14cd641af35ef56e8b1f52507b54b90a%252Fpa%252FDP96573_eb0a68c986111f2ff03ebcb857839f92.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_eb0a68c986111f2ff03ebcb857839f92.jpg already downloaded
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fcd%252F14cd641af35ef56e8b1f52507b54b90a%252Fpa%252FDP96573_f1e4788242a807174cfe7d4bd18f2df5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_f1e4788242a807174cfe7d4bd18f2df5.jpg already downloaded
2026-03-27 11:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3bcbf188-681f-5ef8-915a-1befaf5e4bff, identifier: DP96573
2026-03-27 11:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_87dbf8a5d703b5d0d90ba1826acab3d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_2491d1d2a8fee6ddf78025e22ffdaf0b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_2491d1d2a8fee6ddf78025e22ffdaf0b.jpg not downloaded yet
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_97c3472e84df74ab20c4ab94506e13c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_97c3472e84df74ab20c4ab94506e13c2.jpg not downloaded yet
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_0ebe9a9a3799c4afdc6fc2af0ebc87c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_0ebe9a9a3799c4afdc6fc2af0ebc87c1.jpg not downloaded yet
2026-03-27 11:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK00678/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3bcbf188-681f-5ef8-915a-1befaf5e4bff with identifier: DP96573
2026-03-27 11:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3bcbf188-681f-5ef8-915a-1befaf5e4bff with identifier: DP96573
2026-03-27 11:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3bcbf188-681f-5ef8-915a-1befaf5e4bff with identifier: DP96573 to the API
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DP96573>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:46:23Z',
 'fuel_type': 'petrol',
 'id': '3bcbf188-681f-5ef8-915a-1befaf5e4bff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP96573',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 151445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_b98ab1e4ca56314102fe039d22c5c337.jpg',
                'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_a2a6eb28d294a770204ffcb69f731bc6.jpg',
                'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_f0a0e1f6dc89e772101eed609f90ef5d.jpg',
                'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_7b770158349edb45b42e3a7f37768491.jpg',
                'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_1aeae790ac7f05ef436224df8e7fafa0.jpg',
                'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_cfdfdaf03e8e822e5d47c1304b06cf98.jpg',
                'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_d41591f170fdab3c57a02998e16db074.jpg',
                'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_795f1744205c2de383a622a107544a2e.jpg',
                'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_eb0a68c986111f2ff03ebcb857839f92.jpg',
                'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_f1e4788242a807174cfe7d4bd18f2df5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bcbf188-681f-5ef8-915a-1befaf5e4bff/3bcbf188-681f-5ef8-915a-1befaf5e4bff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_b98ab1e4ca56314102fe039d22c5c337.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bcbf188-681f-5ef8-915a-1befaf5e4bff/3bcbf188-681f-5ef8-915a-1befaf5e4bff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_a2a6eb28d294a770204ffcb69f731bc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bcbf188-681f-5ef8-915a-1befaf5e4bff/3bcbf188-681f-5ef8-915a-1befaf5e4bff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_f0a0e1f6dc89e772101eed609f90ef5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bcbf188-681f-5ef8-915a-1befaf5e4bff/3bcbf188-681f-5ef8-915a-1befaf5e4bff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2900400,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_7b770158349edb45b42e3a7f37768491.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bcbf188-681f-5ef8-915a-1befaf5e4bff/3bcbf188-681f-5ef8-915a-1befaf5e4bff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_1aeae790ac7f05ef436224df8e7fafa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bcbf188-681f-5ef8-915a-1befaf5e4bff/3bcbf188-681f-5ef8-915a-1befaf5e4bff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_cfdfdaf03e8e822e5d47c1304b06cf98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bcbf188-681f-5ef8-915a-1befaf5e4bff/3bcbf188-681f-5ef8-915a-1befaf5e4bff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_d41591f170fdab3c57a02998e16db074.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bcbf188-681f-5ef8-915a-1befaf5e4bff/3bcbf188-681f-5ef8-915a-1befaf5e4bff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3161589,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_795f1744205c2de383a622a107544a2e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bcbf188-681f-5ef8-915a-1befaf5e4bff/3bcbf188-681f-5ef8-915a-1befaf5e4bff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_eb0a68c986111f2ff03ebcb857839f92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bcbf188-681f-5ef8-915a-1befaf5e4bff/3bcbf188-681f-5ef8-915a-1befaf5e4bff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/cd/14cd641af35ef56e8b1f52507b54b90a/pa/DP96573_f1e4788242a807174cfe7d4bd18f2df5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-27 11:30:39 [auto1.be] INFO: Saving data for DP96573: {'created_time': 1774611039.485237, 'last_price_update_time': 1774611039.485249, 'auction_closing_time': 1774716383.0}
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP96573') HTTP/1.1" 204 0
2026-03-27 11:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_3fae8620b44e842ecbd859b67529d749.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:39 [auto1.be] INFO: Found listing with ID: ET95220
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET95220%27 HTTP/1.1" 200 None
2026-03-27 11:30:39 [auto1.be] INFO: Scrape type for ET95220: 1
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fdd%252F50dd562347c04050e0e680a0e32998db%252Fpa%252FUW21644_11f7e20ab1a6e314c347dcb2d8ae5302.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_11f7e20ab1a6e314c347dcb2d8ae5302.jpg not downloaded yet
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_08e791026fac6160782d98c50f5a2505.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_08e791026fac6160782d98c50f5a2505.jpg not downloaded yet
2026-03-27 11:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_4607038a7d9eba460b37ef6833646e04.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_ac150ff4d0a3fdbdc0c5fd30cee46ed8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_2a44f450a07ef3bc0d3f57d8b3ecc33c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_2a44f450a07ef3bc0d3f57d8b3ecc33c.jpg not downloaded yet
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_fe836d0f7f5f6cf17ec205cd59de0a14.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_fe836d0f7f5f6cf17ec205cd59de0a14.jpg not downloaded yet
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_e67f7f6576c86eeae1cc104e500120df.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_e67f7f6576c86eeae1cc104e500120df.jpg not downloaded yet
2026-03-27 11:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c5f250>
2026-03-27 11:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_f3b3def6d3cb70bc345389a1d7db5222.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_f3b3def6d3cb70bc345389a1d7db5222.jpg saved to cache
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f620c6db-e201-522a-a54b-ed85a09b2f43
2026-03-27 11:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c401d0>
2026-03-27 11:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_fdacb2de22a0e6533a627659beffdb2f.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_fdacb2de22a0e6533a627659beffdb2f.jpg saved to cache
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f620c6db-e201-522a-a54b-ed85a09b2f43
2026-03-27 11:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d14110>
2026-03-27 11:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_311903462814993c49ea7113b49e92e0.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_311903462814993c49ea7113b49e92e0.jpg saved to cache
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a9378dd-2203-5033-8a48-292148cd8edf
2026-03-27 11:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74c57867-c58f-5b18-9431-bbd8d599383b with identifier: WH41445
2026-03-27 11:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74c57867-c58f-5b18-9431-bbd8d599383b with scrape type 1
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74c57867-c58f-5b18-9431-bbd8d599383b
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_09408a2ed6c9f55a6898991265a1887c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_09408a2ed6c9f55a6898991265a1887c.jpg not downloaded yet
2026-03-27 11:30:39 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-27 11:30:39 [auto1.be] INFO: Scrape type for KF52558: 2
2026-03-27 11:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eccde05-fbe7-5db7-949b-a124dff01c9f with identifier: KF52558
2026-03-27 11:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eccde05-fbe7-5db7-949b-a124dff01c9f with scrape type 2
2026-03-27 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7eccde05-fbe7-5db7-949b-a124dff01c9f with scrape type 2
2026-03-27 11:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7eccde05-fbe7-5db7-949b-a124dff01c9f, identifier: KF52558
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fdd%252F50dd562347c04050e0e680a0e32998db%252Fpa%252FUW21644_78e7007433a2a4badb2768d7c7f9977c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_78e7007433a2a4badb2768d7c7f9977c.jpg not downloaded yet
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_7a827ed8b4408cfb9a31c09e9c5c3d0a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_7a827ed8b4408cfb9a31c09e9c5c3d0a.jpg not downloaded yet
2026-03-27 11:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED59297/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_dc4b6901a6b6dce5e87e982eb4dae1b7.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7eccde05-fbe7-5db7-949b-a124dff01c9f with identifier: KF52558
2026-03-27 11:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7eccde05-fbe7-5db7-949b-a124dff01c9f with identifier: KF52558
2026-03-27 11:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7eccde05-fbe7-5db7-949b-a124dff01c9f with identifier: KF52558 to the API
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:17:02Z',
 'fuel_type': 'petrol',
 'id': '7eccde05-fbe7-5db7-949b-a124dff01c9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF52558',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 171979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-27 11:30:40 [auto1.be] INFO: Saving data for KF52558: {'auction_closing_time': 1774714622.0, 'created_time': 1773923068.671579, 'last_price_update_time': 1774611040.370742}
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF52558') HTTP/1.1" 204 0
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_b74ded49faff40e61e92fad0abd34e9c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_b74ded49faff40e61e92fad0abd34e9c.jpg not downloaded yet
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_5ef4e8b3575dbff98284fce03132d5aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_5ef4e8b3575dbff98284fce03132d5aa.jpg not downloaded yet
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_34dbcbfe0d9e44e1631fb1a73fc23d13.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_34dbcbfe0d9e44e1631fb1a73fc23d13.jpg not downloaded yet
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_efe9055d667445045e4e23406cfdb10c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_efe9055d667445045e4e23406cfdb10c.jpg not downloaded yet
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c3c4d0>
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_87dbf8a5d703b5d0d90ba1826acab3d8.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_87dbf8a5d703b5d0d90ba1826acab3d8.jpg saved to cache
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a9378dd-2203-5033-8a48-292148cd8edf
2026-03-27 11:30:40 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-27 11:30:40 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-27 11:30:40 [auto1.be] INFO: Scrape type for UJ89543: 2
2026-03-27 11:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with identifier: UJ89543
2026-03-27 11:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with scrape type 2
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with scrape type 2
2026-03-27 11:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f, identifier: UJ89543
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fdd%252F50dd562347c04050e0e680a0e32998db%252Fpa%252FUW21644_707df2c5492bbda49a69b0f3cd8b675d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_707df2c5492bbda49a69b0f3cd8b675d.jpg not downloaded yet
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_0cb098586f55183f668e9defe7cd0121.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_0cb098586f55183f668e9defe7cd0121.jpg not downloaded yet
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3cc0e90>
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_3fae8620b44e842ecbd859b67529d749.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_3fae8620b44e842ecbd859b67529d749.jpg saved to cache
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f620c6db-e201-522a-a54b-ed85a09b2f43
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0ea2090>
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_4607038a7d9eba460b37ef6833646e04.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_4607038a7d9eba460b37ef6833646e04.jpg saved to cache
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f620c6db-e201-522a-a54b-ed85a09b2f43
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b62ed0>
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_ac150ff4d0a3fdbdc0c5fd30cee46ed8.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_ac150ff4d0a3fdbdc0c5fd30cee46ed8.jpg saved to cache
2026-03-27 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8013032f-390a-5eea-966f-854d34707c70
2026-03-27 11:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_248a482c6495128bc281dc4e13aa9cd5.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_416e32a10a2e6712d205513955f709fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_cc352601268d5ff2e5e29380e45bae79.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with identifier: UJ89543
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:30:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-27 11:30:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with identifier: UJ89543
2026-03-27 11:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with identifier: UJ89543 to the API
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:15:20Z',
 'fuel_type': 'diesel',
 'id': 'ba49b4c3-f8dc-57dd-9b37-0930265f7d1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ89543',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 142972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-04',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Adventure',
 'transmission': 'manual',
 'trim': 'Adventure',
 'year': 2014}
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-27 11:30:41 [auto1.be] INFO: Saving data for UJ89543: {'auction_closing_time': 1774714520.0, 'created_time': 1773909041.330022, 'last_price_update_time': 1774611041.530966}
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UJ89543') HTTP/1.1" 204 0
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_4b562d84eea8175112fa50e08f41fc54.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_4b562d84eea8175112fa50e08f41fc54.jpg not downloaded yet
2026-03-27 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_45622b50c8ac1abbde346e5d4f5298cb.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:41 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-27 11:30:41 [auto1.be] INFO: Scrape type for UX94260: 1
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fdd%252F50dd562347c04050e0e680a0e32998db%252Fpa%252FUW21644_ee27d535fed8440f2774527418a5f88f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_ee27d535fed8440f2774527418a5f88f.jpg not downloaded yet
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_2471ac873533b8106d519d864ac79f40.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_2471ac873533b8106d519d864ac79f40.jpg not downloaded yet
2026-03-27 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP09858/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b7be10>
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_dc4b6901a6b6dce5e87e982eb4dae1b7.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_dc4b6901a6b6dce5e87e982eb4dae1b7.jpg saved to cache
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f620c6db-e201-522a-a54b-ed85a09b2f43
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_de771edd825aec23f56d497e4e826289.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_de771edd825aec23f56d497e4e826289.jpg not downloaded yet
2026-03-27 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC17071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:41 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-27 11:30:41 [auto1.be] INFO: Scrape type for FA63464: 1
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_bbeaf77167563bfde2e15ee3239632d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_bbeaf77167563bfde2e15ee3239632d0.jpg not downloaded yet
2026-03-27 11:30:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e29ad0>
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85aef54-640f-5d98-9b99-1c2927a173a1/d85aef54-640f-5d98-9b99-1c2927a173a1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fdd%252F50dd562347c04050e0e680a0e32998db%252Fpa%252FUW21644_248a482c6495128bc281dc4e13aa9cd5.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_248a482c6495128bc281dc4e13aa9cd5.jpg saved to cache
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d85aef54-640f-5d98-9b99-1c2927a173a1
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f2c740d0>
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_416e32a10a2e6712d205513955f709fc.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_416e32a10a2e6712d205513955f709fc.jpg saved to cache
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8013032f-390a-5eea-966f-854d34707c70
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0cfe150>
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_cc352601268d5ff2e5e29380e45bae79.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_cc352601268d5ff2e5e29380e45bae79.jpg saved to cache
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a9378dd-2203-5033-8a48-292148cd8edf
2026-03-27 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_eaf3b4241e7af4502575745b001a5a57.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_3897c0bf44553ffd10957cf3c678002f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_3897c0bf44553ffd10957cf3c678002f.jpg not downloaded yet
2026-03-27 11:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0ed1010>
2026-03-27 11:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_45622b50c8ac1abbde346e5d4f5298cb.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_45622b50c8ac1abbde346e5d4f5298cb.jpg saved to cache
2026-03-27 11:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f620c6db-e201-522a-a54b-ed85a09b2f43
2026-03-27 11:30:42 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-27 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-27 11:30:42 [auto1.be] INFO: Scrape type for WA92632: 2
2026-03-27 11:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with identifier: WA92632
2026-03-27 11:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with scrape type 2
2026-03-27 11:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with scrape type 2
2026-03-27 11:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479, identifier: WA92632
2026-03-27 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_ed46d520ec3d51bf65d8950e621156fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_ed46d520ec3d51bf65d8950e621156fa.jpg not downloaded yet
2026-03-27 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_0ebe9a9a3799c4afdc6fc2af0ebc87c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_97c3472e84df74ab20c4ab94506e13c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_2491d1d2a8fee6ddf78025e22ffdaf0b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with identifier: WA92632
2026-03-27 11:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with identifier: WA92632
2026-03-27 11:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with identifier: WA92632 to the API
2026-03-27 11:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:49:30Z',
 'fuel_type': 'diesel',
 'id': '325dacdd-d8ce-5187-80f3-fdaa6b2f5479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA92632',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 284968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-28',
 'seller_name': None,
 'title': 'Mazda 5 1.6 CD Diesel Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-27 11:30:43 [auto1.be] INFO: Saving data for WA92632: {'auction_closing_time': 1774716570.0, 'created_time': 1773865920.347381, 'last_price_update_time': 1774611043.854654}
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA92632') HTTP/1.1" 204 0
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_65a0833b002c7562d93601be77c2e555.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_65a0833b002c7562d93601be77c2e555.jpg not downloaded yet
2026-03-27 11:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_09408a2ed6c9f55a6898991265a1887c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:43 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-27 11:30:43 [auto1.be] INFO: Scrape type for FN16517: 1
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_9049b5ff6e7cfaf0fe2fcfcf6b663340.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_9049b5ff6e7cfaf0fe2fcfcf6b663340.jpg not downloaded yet
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_575450b3e82bc29887dd9e2e0d00c432.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_575450b3e82bc29887dd9e2e0d00c432.jpg not downloaded yet
2026-03-27 11:30:43 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-27 11:30:43 [auto1.be] INFO: Scrape type for PS61885: 2
2026-03-27 11:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcda966d-d404-5865-9d88-beac13cfd6f7 with identifier: PS61885
2026-03-27 11:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcda966d-d404-5865-9d88-beac13cfd6f7 with scrape type 2
2026-03-27 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcda966d-d404-5865-9d88-beac13cfd6f7 with scrape type 2
2026-03-27 11:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dcda966d-d404-5865-9d88-beac13cfd6f7, identifier: PS61885
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_64d5505865b6e3fbbbe789aff78d9b44.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_64d5505865b6e3fbbbe789aff78d9b44.jpg not downloaded yet
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0eec250>
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_eaf3b4241e7af4502575745b001a5a57.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_eaf3b4241e7af4502575745b001a5a57.jpg saved to cache
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c7e4d0>
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_0ebe9a9a3799c4afdc6fc2af0ebc87c1.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_0ebe9a9a3799c4afdc6fc2af0ebc87c1.jpg saved to cache
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f620c6db-e201-522a-a54b-ed85a09b2f43
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c6a750>
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_97c3472e84df74ab20c4ab94506e13c2.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_97c3472e84df74ab20c4ab94506e13c2.jpg saved to cache
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a9378dd-2203-5033-8a48-292148cd8edf
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c7da90>
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_2491d1d2a8fee6ddf78025e22ffdaf0b.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_2491d1d2a8fee6ddf78025e22ffdaf0b.jpg saved to cache
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8013032f-390a-5eea-966f-854d34707c70
2026-03-27 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_707df2c5492bbda49a69b0f3cd8b675d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_e67f7f6576c86eeae1cc104e500120df.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dcda966d-d404-5865-9d88-beac13cfd6f7 with identifier: PS61885
2026-03-27 11:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dcda966d-d404-5865-9d88-beac13cfd6f7 with identifier: PS61885
2026-03-27 11:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dcda966d-d404-5865-9d88-beac13cfd6f7 with identifier: PS61885 to the API
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:32:11Z',
 'fuel_type': 'diesel',
 'id': 'dcda966d-d404-5865-9d88-beac13cfd6f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS61885',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 211796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-27 11:30:44 [auto1.be] INFO: Saving data for PS61885: {'auction_closing_time': 1774715531.0, 'created_time': 1773922620.738167, 'last_price_update_time': 1774611044.566258}
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS61885') HTTP/1.1" 204 0
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_ee3aed298d19b58fcde43f79e9eafd0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_ee3aed298d19b58fcde43f79e9eafd0d.jpg not downloaded yet
2026-03-27 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_0cb098586f55183f668e9defe7cd0121.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:44 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-27 11:30:44 [auto1.be] INFO: Scrape type for KW38150: 1
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_1b727885e63d92d2360de022755ec933.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_1b727885e63d92d2360de022755ec933.jpg not downloaded yet
2026-03-27 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_efe9055d667445045e4e23406cfdb10c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_01567a2d86e9e7c00a1a5ff6f721e9a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_01567a2d86e9e7c00a1a5ff6f721e9a5.jpg not downloaded yet
2026-03-27 11:30:44 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-27 11:30:44 [auto1.be] INFO: Scrape type for CU40853: 1
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_3a7a0fc364205d0c5b36f4f7d68c2267.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_3a7a0fc364205d0c5b36f4f7d68c2267.jpg not downloaded yet
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a82bd0>
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_09408a2ed6c9f55a6898991265a1887c.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_09408a2ed6c9f55a6898991265a1887c.jpg saved to cache
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74c57867-c58f-5b18-9431-bbd8d599383b
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0f04790>
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85aef54-640f-5d98-9b99-1c2927a173a1/d85aef54-640f-5d98-9b99-1c2927a173a1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fdd%252F50dd562347c04050e0e680a0e32998db%252Fpa%252FUW21644_707df2c5492bbda49a69b0f3cd8b675d.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_707df2c5492bbda49a69b0f3cd8b675d.jpg saved to cache
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d85aef54-640f-5d98-9b99-1c2927a173a1
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a832d0>
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_e67f7f6576c86eeae1cc104e500120df.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_e67f7f6576c86eeae1cc104e500120df.jpg saved to cache
2026-03-27 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f620c6db-e201-522a-a54b-ed85a09b2f43
2026-03-27 11:30:44 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-27 11:30:44 [auto1.be] INFO: Scrape type for KH63709: 1
2026-03-27 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_3897c0bf44553ffd10957cf3c678002f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_bbeaf77167563bfde2e15ee3239632d0.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_4b562d84eea8175112fa50e08f41fc54.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_de771edd825aec23f56d497e4e826289.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:44 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-27 11:30:44 [auto1.be] INFO: Found listing with ID: YL38834
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL38834%27 HTTP/1.1" 200 None
2026-03-27 11:30:44 [auto1.be] INFO: Scrape type for YL38834: 1
2026-03-27 11:30:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_d7e61a5c710a42bff7a0a3088a564f2c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:44 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-27 11:30:44 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-27 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-27 11:30:45 [auto1.be] INFO: Scrape type for MW76341: 1
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3d17ed0>
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_0cb098586f55183f668e9defe7cd0121.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_0cb098586f55183f668e9defe7cd0121.jpg saved to cache
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c55690>
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_efe9055d667445045e4e23406cfdb10c.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_efe9055d667445045e4e23406cfdb10c.jpg saved to cache
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74c57867-c58f-5b18-9431-bbd8d599383b
2026-03-27 11:30:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_64d2bd015a0d4bab33d72257db8156ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_64d5505865b6e3fbbbe789aff78d9b44.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:45 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-27 11:30:45 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-27 11:30:45 [auto1.be] INFO: Scrape type for GF63829: 1
2026-03-27 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_b20db1e15482e1d754092cb5c8cb17e5.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_c6ac9afd0929c6bb56f16ada18256c13.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_ed46d520ec3d51bf65d8950e621156fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:45 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-27 11:30:45 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-27 11:30:45 [auto1.be] INFO: Scrape type for SC04496: 1
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a6b410>
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_3897c0bf44553ffd10957cf3c678002f.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_3897c0bf44553ffd10957cf3c678002f.jpg saved to cache
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74c57867-c58f-5b18-9431-bbd8d599383b
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3d37990>
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_bbeaf77167563bfde2e15ee3239632d0.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_bbeaf77167563bfde2e15ee3239632d0.jpg saved to cache
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e98c90>
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_4b562d84eea8175112fa50e08f41fc54.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_4b562d84eea8175112fa50e08f41fc54.jpg saved to cache
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74c57867-c58f-5b18-9431-bbd8d599383b
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e07990>
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_de771edd825aec23f56d497e4e826289.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_de771edd825aec23f56d497e4e826289.jpg saved to cache
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74c57867-c58f-5b18-9431-bbd8d599383b
2026-03-27 11:30:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c63e10>
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_d7e61a5c710a42bff7a0a3088a564f2c.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_d7e61a5c710a42bff7a0a3088a564f2c.jpg saved to cache
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054
2026-03-27 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_9049b5ff6e7cfaf0fe2fcfcf6b663340.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:45 [auto1.be] INFO: Found listing with ID: UY90554
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY90554%27 HTTP/1.1" 200 None
2026-03-27 11:30:45 [auto1.be] INFO: Scrape type for UY90554: 2
2026-03-27 11:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 437510ac-2e07-5f9c-b489-10eefff69712 with identifier: UY90554
2026-03-27 11:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 437510ac-2e07-5f9c-b489-10eefff69712 with scrape type 2
2026-03-27 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 437510ac-2e07-5f9c-b489-10eefff69712 with scrape type 2
2026-03-27 11:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 437510ac-2e07-5f9c-b489-10eefff69712, identifier: UY90554
2026-03-27 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_3a7a0fc364205d0c5b36f4f7d68c2267.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_01567a2d86e9e7c00a1a5ff6f721e9a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_575450b3e82bc29887dd9e2e0d00c432.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 437510ac-2e07-5f9c-b489-10eefff69712 with identifier: UY90554
2026-03-27 11:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 437510ac-2e07-5f9c-b489-10eefff69712 with identifier: UY90554
2026-03-27 11:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 437510ac-2e07-5f9c-b489-10eefff69712 with identifier: UY90554 to the API
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:34:14Z',
 'fuel_type': 'diesel',
 'id': '437510ac-2e07-5f9c-b489-10eefff69712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY90554',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 140649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-17',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2014}
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY90554%27 HTTP/1.1" 200 None
2026-03-27 11:30:45 [auto1.be] INFO: Saving data for UY90554: {'auction_closing_time': 1774715654.0, 'created_time': 1773434067.320428, 'last_price_update_time': 1774611045.891337}
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY90554') HTTP/1.1" 204 0
2026-03-27 11:30:46 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-27 11:30:46 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-27 11:30:46 [auto1.be] INFO: Scrape type for GW63299: 1
2026-03-27 11:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK00678> (referer: https://www.auto1.com/v1/car-details-view/ZK00678/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED59297> (referer: https://www.auto1.com/v1/car-details-view/ED59297/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:46 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-27 11:30:46 [auto1.be] INFO: Scrape type for MC66522: 1
2026-03-27 11:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA63464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c6a390>
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_64d2bd015a0d4bab33d72257db8156ae.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_64d2bd015a0d4bab33d72257db8156ae.jpg saved to cache
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e36850>
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_64d5505865b6e3fbbbe789aff78d9b44.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_64d5505865b6e3fbbbe789aff78d9b44.jpg saved to cache
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d
2026-03-27 11:30:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3ceb990>
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_b20db1e15482e1d754092cb5c8cb17e5.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_b20db1e15482e1d754092cb5c8cb17e5.jpg saved to cache
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054
2026-03-27 11:30:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3cb75d0>
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_c6ac9afd0929c6bb56f16ada18256c13.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_c6ac9afd0929c6bb56f16ada18256c13.jpg saved to cache
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3ce8b90>
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_ed46d520ec3d51bf65d8950e621156fa.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_ed46d520ec3d51bf65d8950e621156fa.jpg saved to cache
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e37e10>
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_9049b5ff6e7cfaf0fe2fcfcf6b663340.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_9049b5ff6e7cfaf0fe2fcfcf6b663340.jpg saved to cache
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3ceb710>
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_3a7a0fc364205d0c5b36f4f7d68c2267.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_3a7a0fc364205d0c5b36f4f7d68c2267.jpg saved to cache
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74c57867-c58f-5b18-9431-bbd8d599383b
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b06d50>
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_01567a2d86e9e7c00a1a5ff6f721e9a5.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_01567a2d86e9e7c00a1a5ff6f721e9a5.jpg saved to cache
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74c57867-c58f-5b18-9431-bbd8d599383b
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3ce8f90>
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_575450b3e82bc29887dd9e2e0d00c432.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_575450b3e82bc29887dd9e2e0d00c432.jpg saved to cache
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74c57867-c58f-5b18-9431-bbd8d599383b
2026-03-27 11:30:46 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-27 11:30:46 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-27 11:30:46 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-27 11:30:46 [auto1.be] INFO: Scrape type for RN56335: 1
2026-03-27 11:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH63709/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:46 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-27 11:30:46 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-27 11:30:46 [auto1.be] INFO: Scrape type for ZK51965: 2
2026-03-27 11:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with identifier: ZK51965
2026-03-27 11:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with scrape type 2
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with scrape type 2
2026-03-27 11:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a, identifier: ZK51965
2026-03-27 11:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU40853/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with identifier: ZK00678
2026-03-27 11:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with scrape type 1
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_03db590470b62ac7f8c6da8a6d5760ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_03db590470b62ac7f8c6da8a6d5760ec.jpg not downloaded yet
2026-03-27 11:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 159ad276-36e4-5fc6-9705-ac16c83cbb43 with identifier: ED59297
2026-03-27 11:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 159ad276-36e4-5fc6-9705-ac16c83cbb43 with scrape type 1
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 159ad276-36e4-5fc6-9705-ac16c83cbb43
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F93%252Fbe93a08567ada252888914c21a6f45cd%252Fpa%252FED59297_e9cce9ec2687c007b37d13e34df511d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_e9cce9ec2687c007b37d13e34df511d2.jpg already downloaded
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F93%252Fbe93a08567ada252888914c21a6f45cd%252Fpa%252FED59297_4fdd8ee1497bea08a2c7d2bd77d7733f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_4fdd8ee1497bea08a2c7d2bd77d7733f.jpg already downloaded
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F93%252Fbe93a08567ada252888914c21a6f45cd%252Fpa%252FED59297_3bf8a235d2e9e9d35bbe1e4aefe77fa8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_3bf8a235d2e9e9d35bbe1e4aefe77fa8.jpg already downloaded
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F93%252Fbe93a08567ada252888914c21a6f45cd%252Fpa%252FED59297_c96df427abeda033fae9da608695d880.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_c96df427abeda033fae9da608695d880.jpg already downloaded
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F93%252Fbe93a08567ada252888914c21a6f45cd%252Fpa%252FED59297_5b446f778c64ce6c68baf3f26a7a929c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_5b446f778c64ce6c68baf3f26a7a929c.jpg already downloaded
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F93%252Fbe93a08567ada252888914c21a6f45cd%252Fpa%252FED59297_d4619a29148cecfedb21af9a8bc40a58.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_d4619a29148cecfedb21af9a8bc40a58.jpg already downloaded
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F93%252Fbe93a08567ada252888914c21a6f45cd%252Fpa%252FED59297_8f7260756eebc10031e18da7e906136d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_8f7260756eebc10031e18da7e906136d.jpg already downloaded
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F93%252Fbe93a08567ada252888914c21a6f45cd%252Fpa%252FED59297_acd55ffb451c4471f6d50ecb939c7b44.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_acd55ffb451c4471f6d50ecb939c7b44.jpg already downloaded
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F93%252Fbe93a08567ada252888914c21a6f45cd%252Fpa%252FED59297_4ba6c81d2dae7e9031a78c0dfaf43c20.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_4ba6c81d2dae7e9031a78c0dfaf43c20.jpg already downloaded
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F93%252Fbe93a08567ada252888914c21a6f45cd%252Fpa%252FED59297_0015e26f1cde056420a3a359d70a5033.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_0015e26f1cde056420a3a359d70a5033.jpg already downloaded
2026-03-27 11:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 159ad276-36e4-5fc6-9705-ac16c83cbb43, identifier: ED59297
2026-03-27 11:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with identifier: ZK51965
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-27 11:30:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with identifier: ZK51965
2026-03-27 11:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with identifier: ZK51965 to the API
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:38:27Z',
 'fuel_type': 'diesel',
 'id': '4fd9ad0a-1898-5ffe-bb37-005a1e46345a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK51965',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 249855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-28',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-27 11:30:47 [auto1.be] INFO: Saving data for ZK51965: {'auction_closing_time': 1774715907.0, 'created_time': 1773661632.6523, 'last_price_update_time': 1774611047.699163}
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZK51965') HTTP/1.1" 204 0
2026-03-27 11:30:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 159ad276-36e4-5fc6-9705-ac16c83cbb43 with identifier: ED59297
2026-03-27 11:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 159ad276-36e4-5fc6-9705-ac16c83cbb43 with identifier: ED59297
2026-03-27 11:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 159ad276-36e4-5fc6-9705-ac16c83cbb43 with identifier: ED59297 to the API
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ED59297>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:09:22Z',
 'fuel_type': 'petrol',
 'id': '159ad276-36e4-5fc6-9705-ac16c83cbb43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED59297',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 84799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_e9cce9ec2687c007b37d13e34df511d2.jpg',
                'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_4fdd8ee1497bea08a2c7d2bd77d7733f.jpg',
                'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_3bf8a235d2e9e9d35bbe1e4aefe77fa8.jpg',
                'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_c96df427abeda033fae9da608695d880.jpg',
                'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_5b446f778c64ce6c68baf3f26a7a929c.jpg',
                'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_d4619a29148cecfedb21af9a8bc40a58.jpg',
                'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_8f7260756eebc10031e18da7e906136d.jpg',
                'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_acd55ffb451c4471f6d50ecb939c7b44.jpg',
                'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_4ba6c81d2dae7e9031a78c0dfaf43c20.jpg',
                'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_0015e26f1cde056420a3a359d70a5033.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159ad276-36e4-5fc6-9705-ac16c83cbb43/159ad276-36e4-5fc6-9705-ac16c83cbb43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_e9cce9ec2687c007b37d13e34df511d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159ad276-36e4-5fc6-9705-ac16c83cbb43/159ad276-36e4-5fc6-9705-ac16c83cbb43_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_4fdd8ee1497bea08a2c7d2bd77d7733f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159ad276-36e4-5fc6-9705-ac16c83cbb43/159ad276-36e4-5fc6-9705-ac16c83cbb43_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_3bf8a235d2e9e9d35bbe1e4aefe77fa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159ad276-36e4-5fc6-9705-ac16c83cbb43/159ad276-36e4-5fc6-9705-ac16c83cbb43_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_c96df427abeda033fae9da608695d880.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159ad276-36e4-5fc6-9705-ac16c83cbb43/159ad276-36e4-5fc6-9705-ac16c83cbb43_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_5b446f778c64ce6c68baf3f26a7a929c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159ad276-36e4-5fc6-9705-ac16c83cbb43/159ad276-36e4-5fc6-9705-ac16c83cbb43_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_d4619a29148cecfedb21af9a8bc40a58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159ad276-36e4-5fc6-9705-ac16c83cbb43/159ad276-36e4-5fc6-9705-ac16c83cbb43_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_8f7260756eebc10031e18da7e906136d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159ad276-36e4-5fc6-9705-ac16c83cbb43/159ad276-36e4-5fc6-9705-ac16c83cbb43_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_acd55ffb451c4471f6d50ecb939c7b44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159ad276-36e4-5fc6-9705-ac16c83cbb43/159ad276-36e4-5fc6-9705-ac16c83cbb43_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_4ba6c81d2dae7e9031a78c0dfaf43c20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159ad276-36e4-5fc6-9705-ac16c83cbb43/159ad276-36e4-5fc6-9705-ac16c83cbb43_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/93/be93a08567ada252888914c21a6f45cd/pa/ED59297_0015e26f1cde056420a3a359d70a5033.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2023}
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-27 11:30:48 [auto1.be] INFO: Saving data for ED59297: {'created_time': 1774611048.04514, 'last_price_update_time': 1774611048.045149, 'auction_closing_time': 1774714162.0}
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ED59297') HTTP/1.1" 204 0
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_358667c68de48031a83f37948c476ef8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_358667c68de48031a83f37948c476ef8.jpg not downloaded yet
2026-03-27 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_2471ac873533b8106d519d864ac79f40.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL38834/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_65a0833b002c7562d93601be77c2e555.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_e9ca83eba330e607d61b1a98ccdac99d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_e9ca83eba330e607d61b1a98ccdac99d.jpg not downloaded yet
2026-03-27 11:30:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_ddfbf2b5891226b197cc531bcee45c62.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_ddfbf2b5891226b197cc531bcee45c62.jpg not downloaded yet
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_a1cec9a0c03058b514e9d3a066c9b679.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_a1cec9a0c03058b514e9d3a066c9b679.jpg not downloaded yet
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_a0a8e3e1842e1102a11b067a9cdd2acd.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_a0a8e3e1842e1102a11b067a9cdd2acd.jpg not downloaded yet
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_aad99edabd5f8e631242ff56726c76cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_aad99edabd5f8e631242ff56726c76cc.jpg not downloaded yet
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_b062aa23d681800b4e3396a8d2d5a93d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_b062aa23d681800b4e3396a8d2d5a93d.jpg not downloaded yet
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3d34090>
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_2471ac873533b8106d519d864ac79f40.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_2471ac873533b8106d519d864ac79f40.jpg saved to cache
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c69710>
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_65a0833b002c7562d93601be77c2e555.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_65a0833b002c7562d93601be77c2e555.jpg saved to cache
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74c57867-c58f-5b18-9431-bbd8d599383b
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_f56579d18f0ab6085362786ca80e9107.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_f56579d18f0ab6085362786ca80e9107.jpg not downloaded yet
2026-03-27 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_358667c68de48031a83f37948c476ef8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_62d905b8ed744ed967ba4fba108ec3f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_62d905b8ed744ed967ba4fba108ec3f3.jpg not downloaded yet
2026-03-27 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_ee27d535fed8440f2774527418a5f88f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_03db590470b62ac7f8c6da8a6d5760ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_ee3aed298d19b58fcde43f79e9eafd0d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_1b727885e63d92d2360de022755ec933.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0afed10>
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_358667c68de48031a83f37948c476ef8.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_358667c68de48031a83f37948c476ef8.jpg saved to cache
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b11a50>
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85aef54-640f-5d98-9b99-1c2927a173a1/d85aef54-640f-5d98-9b99-1c2927a173a1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fdd%252F50dd562347c04050e0e680a0e32998db%252Fpa%252FUW21644_ee27d535fed8440f2774527418a5f88f.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_ee27d535fed8440f2774527418a5f88f.jpg saved to cache
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d85aef54-640f-5d98-9b99-1c2927a173a1
2026-03-27 11:30:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 11:30:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 11:30:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 11:30:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 11:30:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b2eb50>
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_03db590470b62ac7f8c6da8a6d5760ec.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_03db590470b62ac7f8c6da8a6d5760ec.jpg saved to cache
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa
2026-03-27 11:30:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a66810>
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F88%252F8788c88dca675646857d8218fca1d645%252Fpa%252FWH41445_ee3aed298d19b58fcde43f79e9eafd0d.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_ee3aed298d19b58fcde43f79e9eafd0d.jpg saved to cache
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74c57867-c58f-5b18-9431-bbd8d599383b
2026-03-27 11:30:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74c57867-c58f-5b18-9431-bbd8d599383b, skipping ID generation
2026-03-27 11:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74c57867-c58f-5b18-9431-bbd8d599383b with scrape type 1
2026-03-27 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74c57867-c58f-5b18-9431-bbd8d599383b sending to next pipeline
2026-03-27 11:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 74c57867-c58f-5b18-9431-bbd8d599383b, identifier: WH41445
2026-03-27 11:30:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b0a850>
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_1b727885e63d92d2360de022755ec933.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_1b727885e63d92d2360de022755ec933.jpg saved to cache
2026-03-27 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d
2026-03-27 11:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 74c57867-c58f-5b18-9431-bbd8d599383b with identifier: WH41445
2026-03-27 11:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 74c57867-c58f-5b18-9431-bbd8d599383b with identifier: WH41445
2026-03-27 11:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 74c57867-c58f-5b18-9431-bbd8d599383b with identifier: WH41445 to the API
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_ee3aed298d19b58fcde43f79e9eafd0d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:38:46Z',
 'fuel_type': 'diesel',
 'id': '74c57867-c58f-5b18-9431-bbd8d599383b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH41445',
 'listing': 'auction',
 'location': 'BE, Waver',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 59167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_09408a2ed6c9f55a6898991265a1887c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_efe9055d667445045e4e23406cfdb10c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_4b562d84eea8175112fa50e08f41fc54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_de771edd825aec23f56d497e4e826289.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_3897c0bf44553ffd10957cf3c678002f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_65a0833b002c7562d93601be77c2e555.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_575450b3e82bc29887dd9e2e0d00c432.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2389320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_ee3aed298d19b58fcde43f79e9eafd0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_01567a2d86e9e7c00a1a5ff6f721e9a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74c57867-c58f-5b18-9431-bbd8d599383b/74c57867-c58f-5b18-9431-bbd8d599383b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/88/8788c88dca675646857d8218fca1d645/pa/WH41445_3a7a0fc364205d0c5b36f4f7d68c2267.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2020}
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-27 11:30:49 [auto1.be] INFO: Saving data for WH41445: {'created_time': 1774611049.547412, 'last_price_update_time': 1774611049.54743, 'auction_closing_time': 1774715926.0}
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH41445') HTTP/1.1" 204 0
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_f56579d18f0ab6085362786ca80e9107.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_62d905b8ed744ed967ba4fba108ec3f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC17071> (referer: https://www.auto1.com/v1/car-details-view/CC17071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MC66522/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW63299/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF63829/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW38150/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_b062aa23d681800b4e3396a8d2d5a93d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN16517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW76341/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC04496/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_5ef4e8b3575dbff98284fce03132d5aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_34dbcbfe0d9e44e1631fb1a73fc23d13.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c4d610>
2026-03-27 11:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_f56579d18f0ab6085362786ca80e9107.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_f56579d18f0ab6085362786ca80e9107.jpg saved to cache
2026-03-27 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa
2026-03-27 11:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b4de50>
2026-03-27 11:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_62d905b8ed744ed967ba4fba108ec3f3.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_62d905b8ed744ed967ba4fba108ec3f3.jpg saved to cache
2026-03-27 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_78e7007433a2a4badb2768d7c7f9977c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_a0a8e3e1842e1102a11b067a9cdd2acd.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9609db3f-592b-5e29-9fc3-b596139b736a with identifier: CC17071
2026-03-27 11:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9609db3f-592b-5e29-9fc3-b596139b736a with scrape type 1
2026-03-27 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9609db3f-592b-5e29-9fc3-b596139b736a
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_d24a65d437af2b1f35e262b1a5eadd6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_d24a65d437af2b1f35e262b1a5eadd6e.jpg not downloaded yet
2026-03-27 11:30:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 11:30:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 11:30:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 11:30:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 11:30:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 11:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c7a810>
2026-03-27 11:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_b062aa23d681800b4e3396a8d2d5a93d.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_b062aa23d681800b4e3396a8d2d5a93d.jpg saved to cache
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa
2026-03-27 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_aad99edabd5f8e631242ff56726c76cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_7a827ed8b4408cfb9a31c09e9c5c3d0a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c448d0>
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_5ef4e8b3575dbff98284fce03132d5aa.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_5ef4e8b3575dbff98284fce03132d5aa.jpg saved to cache
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a9378dd-2203-5033-8a48-292148cd8edf
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a9fa50>
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_34dbcbfe0d9e44e1631fb1a73fc23d13.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_34dbcbfe0d9e44e1631fb1a73fc23d13.jpg saved to cache
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f620c6db-e201-522a-a54b-ed85a09b2f43
2026-03-27 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_e9ca83eba330e607d61b1a98ccdac99d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_a1cec9a0c03058b514e9d3a066c9b679.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_b74ded49faff40e61e92fad0abd34e9c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_e87aeccfc7e1eecdfe13301b0c5a84dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_e87aeccfc7e1eecdfe13301b0c5a84dc.jpg not downloaded yet
2026-03-27 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_fe836d0f7f5f6cf17ec205cd59de0a14.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c4ef90>
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85aef54-640f-5d98-9b99-1c2927a173a1/d85aef54-640f-5d98-9b99-1c2927a173a1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fdd%252F50dd562347c04050e0e680a0e32998db%252Fpa%252FUW21644_78e7007433a2a4badb2768d7c7f9977c.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_78e7007433a2a4badb2768d7c7f9977c.jpg saved to cache
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d85aef54-640f-5d98-9b99-1c2927a173a1
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f2f32850>
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_a0a8e3e1842e1102a11b067a9cdd2acd.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_a0a8e3e1842e1102a11b067a9cdd2acd.jpg saved to cache
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_2511f7c883fa676ee374b04e6507ee49.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_2511f7c883fa676ee374b04e6507ee49.jpg not downloaded yet
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a7c5d0>
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_aad99edabd5f8e631242ff56726c76cc.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_aad99edabd5f8e631242ff56726c76cc.jpg saved to cache
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0cfed90>
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_7a827ed8b4408cfb9a31c09e9c5c3d0a.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_7a827ed8b4408cfb9a31c09e9c5c3d0a.jpg saved to cache
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d
2026-03-27 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_08e791026fac6160782d98c50f5a2505.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_11f7e20ab1a6e314c347dcb2d8ae5302.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_2a44f450a07ef3bc0d3f57d8b3ecc33c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_8ddc28b26c1d8316547cc3eb51cb0735.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_8ddc28b26c1d8316547cc3eb51cb0735.jpg not downloaded yet
2026-03-27 11:30:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 11:30:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 11:30:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 11:30:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 11:30:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0aa0f90>
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_e9ca83eba330e607d61b1a98ccdac99d.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_e9ca83eba330e607d61b1a98ccdac99d.jpg saved to cache
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa
2026-03-27 11:30:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 11:30:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 11:30:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 11:30:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 11:30:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3ce9390>
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_a1cec9a0c03058b514e9d3a066c9b679.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_a1cec9a0c03058b514e9d3a066c9b679.jpg saved to cache
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d94e50>
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_b74ded49faff40e61e92fad0abd34e9c.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_b74ded49faff40e61e92fad0abd34e9c.jpg saved to cache
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8013032f-390a-5eea-966f-854d34707c70
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0af1210>
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_fe836d0f7f5f6cf17ec205cd59de0a14.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_fe836d0f7f5f6cf17ec205cd59de0a14.jpg saved to cache
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a9378dd-2203-5033-8a48-292148cd8edf
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_42d967fcf1a4e4964aa77fffa8bbf2af.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_42d967fcf1a4e4964aa77fffa8bbf2af.jpg not downloaded yet
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d9a750>
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff4%252F6ef4a84eb3b352d62726ed9b283d9b3d%252Fpa%252FSZ60181_08e791026fac6160782d98c50f5a2505.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_08e791026fac6160782d98c50f5a2505.jpg saved to cache
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d
2026-03-27 11:30:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d, skipping ID generation
2026-03-27 11:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with scrape type 1
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d sending to next pipeline
2026-03-27 11:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d, identifier: SZ60181
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c98910>
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85aef54-640f-5d98-9b99-1c2927a173a1/d85aef54-640f-5d98-9b99-1c2927a173a1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fdd%252F50dd562347c04050e0e680a0e32998db%252Fpa%252FUW21644_11f7e20ab1a6e314c347dcb2d8ae5302.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_11f7e20ab1a6e314c347dcb2d8ae5302.jpg saved to cache
2026-03-27 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d85aef54-640f-5d98-9b99-1c2927a173a1
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d9a590>
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_2a44f450a07ef3bc0d3f57d8b3ecc33c.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_2a44f450a07ef3bc0d3f57d8b3ecc33c.jpg saved to cache
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8013032f-390a-5eea-966f-854d34707c70
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_538bc3f29a2c025a7ace546d85ad692a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_538bc3f29a2c025a7ace546d85ad692a.jpg not downloaded yet
2026-03-27 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX94260/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with identifier: SZ60181
2026-03-27 11:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with identifier: SZ60181
2026-03-27 11:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with identifier: SZ60181 to the API
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_08e791026fac6160782d98c50f5a2505.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:15:20Z',
 'fuel_type': 'diesel',
 'id': '7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ60181',
 'listing': 'auction',
 'location': 'BE, Brugge',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 137341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_eaf3b4241e7af4502575745b001a5a57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_08e791026fac6160782d98c50f5a2505.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_7a827ed8b4408cfb9a31c09e9c5c3d0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_0cb098586f55183f668e9defe7cd0121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_2471ac873533b8106d519d864ac79f40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_bbeaf77167563bfde2e15ee3239632d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_ed46d520ec3d51bf65d8950e621156fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_9049b5ff6e7cfaf0fe2fcfcf6b663340.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_64d5505865b6e3fbbbe789aff78d9b44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d/7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2513745,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f4/6ef4a84eb3b352d62726ed9b283d9b3d/pa/SZ60181_1b727885e63d92d2360de022755ec933.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.9 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [auto1.be] INFO: Saving data for SZ60181: {'created_time': 1774611051.594755, 'last_price_update_time': 1774611051.594767, 'auction_closing_time': 1774714520.0}
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ60181') HTTP/1.1" 204 0
2026-03-27 11:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_02ad303cbbfa50546bc9246b88aea959.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_02ad303cbbfa50546bc9246b88aea959.jpg not downloaded yet
2026-03-27 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET95220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN56335/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU40853> (referer: https://www.auto1.com/v1/car-details-view/CU40853/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA63464> (referer: https://www.auto1.com/v1/car-details-view/FA63464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP09858> (referer: https://www.auto1.com/v1/car-details-view/EP09858/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH63709> (referer: https://www.auto1.com/v1/car-details-view/KH63709/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL38834> (referer: https://www.auto1.com/v1/car-details-view/YL38834/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_fc449328b2b7b3c87dc623f946597c89.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_fc449328b2b7b3c87dc623f946597c89.jpg not downloaded yet
2026-03-27 11:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_ee7c2554bd31dd9614f9afc673849c4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_ee7c2554bd31dd9614f9afc673849c4c.jpg not downloaded yet
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_6526c6ef993d8bb234a31d3a571a9810.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_6526c6ef993d8bb234a31d3a571a9810.jpg not downloaded yet
2026-03-27 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_ddfbf2b5891226b197cc531bcee45c62.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_2511f7c883fa676ee374b04e6507ee49.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_d24a65d437af2b1f35e262b1a5eadd6e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with identifier: CU40853
2026-03-27 11:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with scrape type 1
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F64%252F5764c7dcc24012c09b7c9f1290f7da54%252Fpa%252FCU40853_5f6cf9e2a67d9a68ac4eb88574dc5d72.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_5f6cf9e2a67d9a68ac4eb88574dc5d72.jpg already downloaded
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F64%252F5764c7dcc24012c09b7c9f1290f7da54%252Fpa%252FCU40853_e8919ed939b32fa57a663255bc530ad2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_e8919ed939b32fa57a663255bc530ad2.jpg already downloaded
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F64%252F5764c7dcc24012c09b7c9f1290f7da54%252Fpa%252FCU40853_c70ee2c9f2191dbf47b5f2bbe50ee8d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_c70ee2c9f2191dbf47b5f2bbe50ee8d6.jpg already downloaded
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F64%252F5764c7dcc24012c09b7c9f1290f7da54%252Fpa%252FCU40853_89386523942215f4afe4534c5227582a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_89386523942215f4afe4534c5227582a.jpg already downloaded
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F64%252F5764c7dcc24012c09b7c9f1290f7da54%252Fpa%252FCU40853_302f3d921841f979188af65c7c6c6dbe.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_302f3d921841f979188af65c7c6c6dbe.jpg already downloaded
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F64%252F5764c7dcc24012c09b7c9f1290f7da54%252Fpa%252FCU40853_24c5a2526b161db752db26a343809182.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_24c5a2526b161db752db26a343809182.jpg already downloaded
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F64%252F5764c7dcc24012c09b7c9f1290f7da54%252Fpa%252FCU40853_b7a1e8f66b1877742b78d1db15744c01.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_b7a1e8f66b1877742b78d1db15744c01.jpg already downloaded
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F64%252F5764c7dcc24012c09b7c9f1290f7da54%252Fpa%252FCU40853_42129eb87741c25423e5d4c58538b91f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_42129eb87741c25423e5d4c58538b91f.jpg already downloaded
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F64%252F5764c7dcc24012c09b7c9f1290f7da54%252Fpa%252FCU40853_3a87be2e84f1b00f057ac58f15e71042.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_3a87be2e84f1b00f057ac58f15e71042.jpg already downloaded
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F64%252F5764c7dcc24012c09b7c9f1290f7da54%252Fpa%252FCU40853_48ba5acb5fff04137b9f5dcdaaeda3a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_48ba5acb5fff04137b9f5dcdaaeda3a0.jpg already downloaded
2026-03-27 11:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6, identifier: CU40853
2026-03-27 11:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d55df2ce-ceec-5a04-8351-8bfe516065a5 with identifier: FA63464
2026-03-27 11:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d55df2ce-ceec-5a04-8351-8bfe516065a5 with scrape type 1
2026-03-27 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d55df2ce-ceec-5a04-8351-8bfe516065a5
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff1%252Ffbf112077d438ca47ef6c487debe59d8%252Fpa%252FFA63464_d02ecae5d5cb448084ceff2f4d4f2008.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_d02ecae5d5cb448084ceff2f4d4f2008.jpg already downloaded
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff1%252Ffbf112077d438ca47ef6c487debe59d8%252Fpa%252FFA63464_31a50f585a92f15bd856d8ea29745d77.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_31a50f585a92f15bd856d8ea29745d77.jpg already downloaded
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff1%252Ffbf112077d438ca47ef6c487debe59d8%252Fpa%252FFA63464_81fa02a73536db93943198835b56da24.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_81fa02a73536db93943198835b56da24.jpg already downloaded
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff1%252Ffbf112077d438ca47ef6c487debe59d8%252Fpa%252FFA63464_5d3901010f402e40a9d8b1922227aa33.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_5d3901010f402e40a9d8b1922227aa33.jpg already downloaded
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff1%252Ffbf112077d438ca47ef6c487debe59d8%252Fpa%252FFA63464_8045dad16ac86b3b9806338fb17fa216.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_8045dad16ac86b3b9806338fb17fa216.jpg already downloaded
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff1%252Ffbf112077d438ca47ef6c487debe59d8%252Fpa%252FFA63464_077ecfb79be3dacc09d6d539a3986738.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_077ecfb79be3dacc09d6d539a3986738.jpg already downloaded
2026-03-27 11:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d55df2ce-ceec-5a04-8351-8bfe516065a5, identifier: FA63464
2026-03-27 11:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e537b69b-6ce4-5e73-9c9e-7817832184b8 with identifier: EP09858
2026-03-27 11:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e537b69b-6ce4-5e73-9c9e-7817832184b8 with scrape type 1
2026-03-27 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e537b69b-6ce4-5e73-9c9e-7817832184b8
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_76bff5f3c792a1171d5fb37f3a0d8d99.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_76bff5f3c792a1171d5fb37f3a0d8d99.jpg not downloaded yet
2026-03-27 11:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with identifier: CU40853
2026-03-27 11:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with identifier: CU40853
2026-03-27 11:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with identifier: CU40853 to the API
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CU40853>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:14:48Z',
 'fuel_type': 'diesel',
 'id': 'd0c41ed0-9f3f-51bc-98be-62ba5f38d0a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU40853',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 139354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_5f6cf9e2a67d9a68ac4eb88574dc5d72.jpg',
                'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_e8919ed939b32fa57a663255bc530ad2.jpg',
                'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_c70ee2c9f2191dbf47b5f2bbe50ee8d6.jpg',
                'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_89386523942215f4afe4534c5227582a.jpg',
                'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_302f3d921841f979188af65c7c6c6dbe.jpg',
                'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_24c5a2526b161db752db26a343809182.jpg',
                'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_b7a1e8f66b1877742b78d1db15744c01.jpg',
                'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_42129eb87741c25423e5d4c58538b91f.jpg',
                'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_3a87be2e84f1b00f057ac58f15e71042.jpg',
                'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_48ba5acb5fff04137b9f5dcdaaeda3a0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6/d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_5f6cf9e2a67d9a68ac4eb88574dc5d72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6/d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_e8919ed939b32fa57a663255bc530ad2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6/d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_c70ee2c9f2191dbf47b5f2bbe50ee8d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6/d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_89386523942215f4afe4534c5227582a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6/d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_302f3d921841f979188af65c7c6c6dbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6/d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_24c5a2526b161db752db26a343809182.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6/d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_b7a1e8f66b1877742b78d1db15744c01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6/d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_42129eb87741c25423e5d4c58538b91f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6/d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_3a87be2e84f1b00f057ac58f15e71042.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6/d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/64/5764c7dcc24012c09b7c9f1290f7da54/pa/CU40853_48ba5acb5fff04137b9f5dcdaaeda3a0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-27 11:30:52 [auto1.be] INFO: Saving data for CU40853: {'created_time': 1774611052.627411, 'last_price_update_time': 1774611052.627421, 'auction_closing_time': 1774714488.0}
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CU40853') HTTP/1.1" 204 0
2026-03-27 11:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d55df2ce-ceec-5a04-8351-8bfe516065a5 with identifier: FA63464
2026-03-27 11:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d55df2ce-ceec-5a04-8351-8bfe516065a5 with identifier: FA63464
2026-03-27 11:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d55df2ce-ceec-5a04-8351-8bfe516065a5 with identifier: FA63464 to the API
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FA63464>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:12:44Z',
 'fuel_type': 'diesel',
 'id': 'd55df2ce-ceec-5a04-8351-8bfe516065a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA63464',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 252739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_d02ecae5d5cb448084ceff2f4d4f2008.jpg',
                'https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_31a50f585a92f15bd856d8ea29745d77.jpg',
                'https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_81fa02a73536db93943198835b56da24.jpg',
                'https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_5d3901010f402e40a9d8b1922227aa33.jpg',
                'https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_8045dad16ac86b3b9806338fb17fa216.jpg',
                'https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_077ecfb79be3dacc09d6d539a3986738.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d55df2ce-ceec-5a04-8351-8bfe516065a5/d55df2ce-ceec-5a04-8351-8bfe516065a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_d02ecae5d5cb448084ceff2f4d4f2008.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d55df2ce-ceec-5a04-8351-8bfe516065a5/d55df2ce-ceec-5a04-8351-8bfe516065a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_31a50f585a92f15bd856d8ea29745d77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d55df2ce-ceec-5a04-8351-8bfe516065a5/d55df2ce-ceec-5a04-8351-8bfe516065a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_81fa02a73536db93943198835b56da24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d55df2ce-ceec-5a04-8351-8bfe516065a5/d55df2ce-ceec-5a04-8351-8bfe516065a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_5d3901010f402e40a9d8b1922227aa33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d55df2ce-ceec-5a04-8351-8bfe516065a5/d55df2ce-ceec-5a04-8351-8bfe516065a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_8045dad16ac86b3b9806338fb17fa216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d55df2ce-ceec-5a04-8351-8bfe516065a5/d55df2ce-ceec-5a04-8351-8bfe516065a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f1/fbf112077d438ca47ef6c487debe59d8/pa/FA63464_077ecfb79be3dacc09d6d539a3986738.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-27 11:30:52 [auto1.be] INFO: Saving data for FA63464: {'created_time': 1774611052.962473, 'last_price_update_time': 1774611052.962485, 'auction_closing_time': 1774714364.0}
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA63464') HTTP/1.1" 204 0
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_af49eb9a750d17f362a9f1de9eb41a7d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_af49eb9a750d17f362a9f1de9eb41a7d.jpg not downloaded yet
2026-03-27 11:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_8ddc28b26c1d8316547cc3eb51cb0735.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_42d967fcf1a4e4964aa77fffa8bbf2af.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_02ad303cbbfa50546bc9246b88aea959.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa5cf44f-85cf-574c-9a6a-af491c81ab86 with identifier: KH63709
2026-03-27 11:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa5cf44f-85cf-574c-9a6a-af491c81ab86 with scrape type 1
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa5cf44f-85cf-574c-9a6a-af491c81ab86
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_dd347c8378285baae51e7736b016e4a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_dd347c8378285baae51e7736b016e4a7.jpg not downloaded yet
2026-03-27 11:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df457952-461f-5c61-b3da-6896d1814d49 with identifier: YL38834
2026-03-27 11:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df457952-461f-5c61-b3da-6896d1814d49 with scrape type 1
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df457952-461f-5c61-b3da-6896d1814d49
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_da9b409de6e94a3b91b59b0c241d7080.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_da9b409de6e94a3b91b59b0c241d7080.jpg not downloaded yet
2026-03-27 11:30:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0f1bc10>
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fb3%252F50b328a6bfd327ccc9a3e73cce23b473%252Fpa%252FZK00678_ddfbf2b5891226b197cc531bcee45c62.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_ddfbf2b5891226b197cc531bcee45c62.jpg saved to cache
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa
2026-03-27 11:30:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa, skipping ID generation
2026-03-27 11:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with scrape type 1
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa sending to next pipeline
2026-03-27 11:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa, identifier: ZK00678
2026-03-27 11:30:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3cb74d0>
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_2511f7c883fa676ee374b04e6507ee49.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_2511f7c883fa676ee374b04e6507ee49.jpg saved to cache
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9609db3f-592b-5e29-9fc3-b596139b736a
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b09850>
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_d24a65d437af2b1f35e262b1a5eadd6e.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_d24a65d437af2b1f35e262b1a5eadd6e.jpg saved to cache
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9609db3f-592b-5e29-9fc3-b596139b736a
2026-03-27 11:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_4d4ac06cf6afb9c0604ef2b15fcb3e32.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_9f8d57b04a25b31c4099b84ca12c8bd9.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_9f8d57b04a25b31c4099b84ca12c8bd9.jpg not downloaded yet
2026-03-27 11:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with identifier: ZK00678
2026-03-27 11:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with identifier: ZK00678
2026-03-27 11:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with identifier: ZK00678 to the API
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_ddfbf2b5891226b197cc531bcee45c62.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:12:24Z',
 'fuel_type': 'diesel',
 'id': '569eba0d-a06b-53bf-b4bc-4c5b5891dffa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK00678',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 148171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402043,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_03db590470b62ac7f8c6da8a6d5760ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_358667c68de48031a83f37948c476ef8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_e9ca83eba330e607d61b1a98ccdac99d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2902352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_ddfbf2b5891226b197cc531bcee45c62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359459,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_a1cec9a0c03058b514e9d3a066c9b679.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_a0a8e3e1842e1102a11b067a9cdd2acd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_aad99edabd5f8e631242ff56726c76cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 397776,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_b062aa23d681800b4e3396a8d2d5a93d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_f56579d18f0ab6085362786ca80e9107.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569eba0d-a06b-53bf-b4bc-4c5b5891dffa/569eba0d-a06b-53bf-b4bc-4c5b5891dffa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/b3/50b328a6bfd327ccc9a3e73cce23b473/pa/ZK00678_62d905b8ed744ed967ba4fba108ec3f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Roomster 1.6 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2013}
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-27 11:30:53 [auto1.be] INFO: Saving data for ZK00678: {'created_time': 1774611053.857631, 'last_price_update_time': 1774611053.85764, 'auction_closing_time': 1774714344.0}
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZK00678') HTTP/1.1" 204 0
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_c2ff0a36f7dbbfe10e5f16dcd3e70270.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_c2ff0a36f7dbbfe10e5f16dcd3e70270.jpg not downloaded yet
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_876deff955d03afbcbcd5b6e54fcf296.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_876deff955d03afbcbcd5b6e54fcf296.jpg not downloaded yet
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_b5386e822e06e497ae3a3ac912d94f0a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_b5386e822e06e497ae3a3ac912d94f0a.jpg not downloaded yet
2026-03-27 11:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC04496> (referer: https://www.auto1.com/v1/car-details-view/SC04496/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_5b57564d034dee547fdd847990f9b86b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_5b57564d034dee547fdd847990f9b86b.jpg not downloaded yet
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_edbb1972e047490f39bc9896cd7d400d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_edbb1972e047490f39bc9896cd7d400d.jpg not downloaded yet
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0af1510>
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_8ddc28b26c1d8316547cc3eb51cb0735.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_8ddc28b26c1d8316547cc3eb51cb0735.jpg saved to cache
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9609db3f-592b-5e29-9fc3-b596139b736a
2026-03-27 11:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e0fc90>
2026-03-27 11:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_42d967fcf1a4e4964aa77fffa8bbf2af.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_42d967fcf1a4e4964aa77fffa8bbf2af.jpg saved to cache
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9609db3f-592b-5e29-9fc3-b596139b736a
2026-03-27 11:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0dd1990>
2026-03-27 11:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_02ad303cbbfa50546bc9246b88aea959.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_02ad303cbbfa50546bc9246b88aea959.jpg saved to cache
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9609db3f-592b-5e29-9fc3-b596139b736a
2026-03-27 11:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f670090dd90>
2026-03-27 11:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85aef54-640f-5d98-9b99-1c2927a173a1/d85aef54-640f-5d98-9b99-1c2927a173a1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fdd%252F50dd562347c04050e0e680a0e32998db%252Fpa%252FUW21644_4d4ac06cf6afb9c0604ef2b15fcb3e32.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_4d4ac06cf6afb9c0604ef2b15fcb3e32.jpg saved to cache
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d85aef54-640f-5d98-9b99-1c2927a173a1
2026-03-27 11:30:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d85aef54-640f-5d98-9b99-1c2927a173a1, skipping ID generation
2026-03-27 11:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85aef54-640f-5d98-9b99-1c2927a173a1 with scrape type 1
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d85aef54-640f-5d98-9b99-1c2927a173a1 sending to next pipeline
2026-03-27 11:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d85aef54-640f-5d98-9b99-1c2927a173a1, identifier: UW21644
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_c33239db7bbeae5750c12b8386477b70.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_c33239db7bbeae5750c12b8386477b70.jpg not downloaded yet
2026-03-27 11:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d85aef54-640f-5d98-9b99-1c2927a173a1 with identifier: UW21644
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-27 11:30:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d85aef54-640f-5d98-9b99-1c2927a173a1 with identifier: UW21644
2026-03-27 11:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d85aef54-640f-5d98-9b99-1c2927a173a1 with identifier: UW21644 to the API
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_4d4ac06cf6afb9c0604ef2b15fcb3e32.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:27:24Z',
 'fuel_type': 'diesel',
 'id': 'd85aef54-640f-5d98-9b99-1c2927a173a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW21644',
 'listing': 'auction',
 'location': 'BE, Herentals',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 259485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85aef54-640f-5d98-9b99-1c2927a173a1/d85aef54-640f-5d98-9b99-1c2927a173a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_248a482c6495128bc281dc4e13aa9cd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85aef54-640f-5d98-9b99-1c2927a173a1/d85aef54-640f-5d98-9b99-1c2927a173a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_4d4ac06cf6afb9c0604ef2b15fcb3e32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85aef54-640f-5d98-9b99-1c2927a173a1/d85aef54-640f-5d98-9b99-1c2927a173a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_11f7e20ab1a6e314c347dcb2d8ae5302.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85aef54-640f-5d98-9b99-1c2927a173a1/d85aef54-640f-5d98-9b99-1c2927a173a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_78e7007433a2a4badb2768d7c7f9977c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85aef54-640f-5d98-9b99-1c2927a173a1/d85aef54-640f-5d98-9b99-1c2927a173a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_707df2c5492bbda49a69b0f3cd8b675d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85aef54-640f-5d98-9b99-1c2927a173a1/d85aef54-640f-5d98-9b99-1c2927a173a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/dd/50dd562347c04050e0e680a0e32998db/pa/UW21644_ee27d535fed8440f2774527418a5f88f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2010}
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-27 11:30:54 [auto1.be] INFO: Saving data for UW21644: {'created_time': 1774611054.735589, 'last_price_update_time': 1774611054.7356, 'auction_closing_time': 1774715244.0}
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UW21644') HTTP/1.1" 204 0
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_4929f697d7e0450aa40acc2bc46e01bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_4929f697d7e0450aa40acc2bc46e01bf.jpg not downloaded yet
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_2a1003795f62d65bbfdd8052985476c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_2a1003795f62d65bbfdd8052985476c6.jpg not downloaded yet
2026-03-27 11:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_e87aeccfc7e1eecdfe13301b0c5a84dc.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_76bff5f3c792a1171d5fb37f3a0d8d99.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_9f8d57b04a25b31c4099b84ca12c8bd9.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_f05e8643d02bdfb91c176d9fbee83be5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_f05e8643d02bdfb91c176d9fbee83be5.jpg not downloaded yet
2026-03-27 11:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF63829> (referer: https://www.auto1.com/v1/car-details-view/GF63829/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW38150> (referer: https://www.auto1.com/v1/car-details-view/KW38150/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN16517> (referer: https://www.auto1.com/v1/car-details-view/FN16517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MC66522> (referer: https://www.auto1.com/v1/car-details-view/MC66522/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c99fa020-c354-5391-9f85-b5505442b785 with identifier: SC04496
2026-03-27 11:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99fa020-c354-5391-9f85-b5505442b785 with scrape type 1
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c99fa020-c354-5391-9f85-b5505442b785
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fa2%252F1fa2d1ba62193f73e5711f1f5b9a07eb%252Fpa%252FSC04496_a56cfae15eb434d6e60e9d818aa17a7b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_a56cfae15eb434d6e60e9d818aa17a7b.jpg already downloaded
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fa2%252F1fa2d1ba62193f73e5711f1f5b9a07eb%252Fpa%252FSC04496_db8132d5ec79f21cb26d97a750216e19.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_db8132d5ec79f21cb26d97a750216e19.jpg already downloaded
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fa2%252F1fa2d1ba62193f73e5711f1f5b9a07eb%252Fpa%252FSC04496_108467700492e407eafd1185851d5071.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_108467700492e407eafd1185851d5071.jpg already downloaded
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fa2%252F1fa2d1ba62193f73e5711f1f5b9a07eb%252Fpa%252FSC04496_1311cbb8062d1bb6f64da54d109b45a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_1311cbb8062d1bb6f64da54d109b45a2.jpg already downloaded
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fa2%252F1fa2d1ba62193f73e5711f1f5b9a07eb%252Fpa%252FSC04496_aab297901c2847a86747749ecf98696f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_aab297901c2847a86747749ecf98696f.jpg already downloaded
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fa2%252F1fa2d1ba62193f73e5711f1f5b9a07eb%252Fpa%252FSC04496_1da5112161c98edb14fe4ddb5226eb20.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_1da5112161c98edb14fe4ddb5226eb20.jpg already downloaded
2026-03-27 11:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c99fa020-c354-5391-9f85-b5505442b785, identifier: SC04496
2026-03-27 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_da9b409de6e94a3b91b59b0c241d7080.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_dd347c8378285baae51e7736b016e4a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_af49eb9a750d17f362a9f1de9eb41a7d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_8bc5cef8c9a9d4559bc3a0474cb185df.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_8bc5cef8c9a9d4559bc3a0474cb185df.jpg not downloaded yet
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_2c7b6f1007b76c75bb8083e33678f445.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_2c7b6f1007b76c75bb8083e33678f445.jpg not downloaded yet
2026-03-27 11:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c99fa020-c354-5391-9f85-b5505442b785 with identifier: SC04496
2026-03-27 11:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c99fa020-c354-5391-9f85-b5505442b785 with identifier: SC04496
2026-03-27 11:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c99fa020-c354-5391-9f85-b5505442b785 with identifier: SC04496 to the API
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC04496>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:46:58Z',
 'fuel_type': 'diesel',
 'id': 'c99fa020-c354-5391-9f85-b5505442b785',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC04496',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 167902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_a56cfae15eb434d6e60e9d818aa17a7b.jpg',
                'https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_db8132d5ec79f21cb26d97a750216e19.jpg',
                'https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_108467700492e407eafd1185851d5071.jpg',
                'https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_1311cbb8062d1bb6f64da54d109b45a2.jpg',
                'https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_aab297901c2847a86747749ecf98696f.jpg',
                'https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_1da5112161c98edb14fe4ddb5226eb20.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99fa020-c354-5391-9f85-b5505442b785/c99fa020-c354-5391-9f85-b5505442b785_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_a56cfae15eb434d6e60e9d818aa17a7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99fa020-c354-5391-9f85-b5505442b785/c99fa020-c354-5391-9f85-b5505442b785_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_db8132d5ec79f21cb26d97a750216e19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99fa020-c354-5391-9f85-b5505442b785/c99fa020-c354-5391-9f85-b5505442b785_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_108467700492e407eafd1185851d5071.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99fa020-c354-5391-9f85-b5505442b785/c99fa020-c354-5391-9f85-b5505442b785_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_1311cbb8062d1bb6f64da54d109b45a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99fa020-c354-5391-9f85-b5505442b785/c99fa020-c354-5391-9f85-b5505442b785_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_aab297901c2847a86747749ecf98696f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99fa020-c354-5391-9f85-b5505442b785/c99fa020-c354-5391-9f85-b5505442b785_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/a2/1fa2d1ba62193f73e5711f1f5b9a07eb/pa/SC04496_1da5112161c98edb14fe4ddb5226eb20.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2009}
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [auto1.be] INFO: Saving data for SC04496: {'created_time': 1774611055.380757, 'last_price_update_time': 1774611055.380769, 'auction_closing_time': 1774716418.0}
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC04496') HTTP/1.1" 204 0
2026-03-27 11:30:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_ec7fa32b6292ee654b464d9708d42baf.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_ec7fa32b6292ee654b464d9708d42baf.jpg not downloaded yet
2026-03-27 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW63299> (referer: https://www.auto1.com/v1/car-details-view/GW63299/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_acf38e3a889d9d4fa94613448927f80f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_acf38e3a889d9d4fa94613448927f80f.jpg not downloaded yet
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_cbcaf45ddfc4d023628c8fc908ebf01d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_cbcaf45ddfc4d023628c8fc908ebf01d.jpg not downloaded yet
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_c2b8a2a3f37d505618211345e7a38162.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_c2b8a2a3f37d505618211345e7a38162.jpg not downloaded yet
2026-03-27 11:30:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b33b90>
2026-03-27 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_e87aeccfc7e1eecdfe13301b0c5a84dc.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_e87aeccfc7e1eecdfe13301b0c5a84dc.jpg saved to cache
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9609db3f-592b-5e29-9fc3-b596139b736a
2026-03-27 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d638d0>
2026-03-27 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_76bff5f3c792a1171d5fb37f3a0d8d99.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_76bff5f3c792a1171d5fb37f3a0d8d99.jpg saved to cache
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e537b69b-6ce4-5e73-9c9e-7817832184b8
2026-03-27 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c43ad0>
2026-03-27 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_9f8d57b04a25b31c4099b84ca12c8bd9.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_9f8d57b04a25b31c4099b84ca12c8bd9.jpg saved to cache
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e537b69b-6ce4-5e73-9c9e-7817832184b8
2026-03-27 11:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da83eef-9ce5-50b7-b5f9-8652db35b71c with identifier: GF63829
2026-03-27 11:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da83eef-9ce5-50b7-b5f9-8652db35b71c with scrape type 1
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5da83eef-9ce5-50b7-b5f9-8652db35b71c
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F92%252F289238e56021a82878efea149fa1d901%252Fpa%252FGF63829_b4ba62cd45f9f174e194d8bc11db0a96.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_b4ba62cd45f9f174e194d8bc11db0a96.jpg already downloaded
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F92%252F289238e56021a82878efea149fa1d901%252Fpa%252FGF63829_ecaf81e3b550c989a660f5897aebcf04.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_ecaf81e3b550c989a660f5897aebcf04.jpg already downloaded
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F92%252F289238e56021a82878efea149fa1d901%252Fpa%252FGF63829_9ff864df068f783c4115cf5b645b3232.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_9ff864df068f783c4115cf5b645b3232.jpg already downloaded
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F92%252F289238e56021a82878efea149fa1d901%252Fpa%252FGF63829_12cf499d52da0d84eda50673955b4e20.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_12cf499d52da0d84eda50673955b4e20.jpg already downloaded
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F92%252F289238e56021a82878efea149fa1d901%252Fpa%252FGF63829_2f65002e64de8aef0fc8933569f097fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_2f65002e64de8aef0fc8933569f097fc.jpg already downloaded
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F92%252F289238e56021a82878efea149fa1d901%252Fpa%252FGF63829_8b181c67cf50c49a02b53b19c485ea3a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_8b181c67cf50c49a02b53b19c485ea3a.jpg already downloaded
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F92%252F289238e56021a82878efea149fa1d901%252Fpa%252FGF63829_cdc27b66d5a009a2e17a4fef11814068.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_cdc27b66d5a009a2e17a4fef11814068.jpg already downloaded
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F92%252F289238e56021a82878efea149fa1d901%252Fpa%252FGF63829_fa1d48fc5758a6f415d36eb6a660eacc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_fa1d48fc5758a6f415d36eb6a660eacc.jpg already downloaded
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F92%252F289238e56021a82878efea149fa1d901%252Fpa%252FGF63829_9dbe10773c7706dfacde5b61d99e50db.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_9dbe10773c7706dfacde5b61d99e50db.jpg already downloaded
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F92%252F289238e56021a82878efea149fa1d901%252Fpa%252FGF63829_5a27978c2c49e6bf258657368d933798.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_5a27978c2c49e6bf258657368d933798.jpg already downloaded
2026-03-27 11:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5da83eef-9ce5-50b7-b5f9-8652db35b71c, identifier: GF63829
2026-03-27 11:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ce9160-39cd-5582-a186-21b1728d97d7 with identifier: KW38150
2026-03-27 11:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ce9160-39cd-5582-a186-21b1728d97d7 with scrape type 1
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62ce9160-39cd-5582-a186-21b1728d97d7
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_24d2778aa305f0fc8a95967f43c63f00.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_24d2778aa305f0fc8a95967f43c63f00.jpg not downloaded yet
2026-03-27 11:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with identifier: FN16517
2026-03-27 11:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with scrape type 1
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a90caf3-f8a5-56c6-9be0-336444f5ad60
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F90%252F309016f65ae9362b42b4d55268c1feca%252Fpa%252FFN16517_11d72804989762602e0ede43eed5396c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_11d72804989762602e0ede43eed5396c.jpg already downloaded
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F90%252F309016f65ae9362b42b4d55268c1feca%252Fpa%252FFN16517_92ab3c0843aa5741a2a8507283d850ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_92ab3c0843aa5741a2a8507283d850ad.jpg already downloaded
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F90%252F309016f65ae9362b42b4d55268c1feca%252Fpa%252FFN16517_1313aad5b5522d14d626a4f5e08932d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_1313aad5b5522d14d626a4f5e08932d0.jpg already downloaded
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F90%252F309016f65ae9362b42b4d55268c1feca%252Fpa%252FFN16517_468c241594ba9a736185345c662214d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_468c241594ba9a736185345c662214d5.jpg already downloaded
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F90%252F309016f65ae9362b42b4d55268c1feca%252Fpa%252FFN16517_458a5effd49a481b7e9c02efa217868d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_458a5effd49a481b7e9c02efa217868d.jpg already downloaded
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F90%252F309016f65ae9362b42b4d55268c1feca%252Fpa%252FFN16517_376010bd57856ffc2d77f8ea824d01bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_376010bd57856ffc2d77f8ea824d01bb.jpg already downloaded
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F90%252F309016f65ae9362b42b4d55268c1feca%252Fpa%252FFN16517_38b3777f04a5ddda5e8b51cf9717e69e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_38b3777f04a5ddda5e8b51cf9717e69e.jpg already downloaded
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F90%252F309016f65ae9362b42b4d55268c1feca%252Fpa%252FFN16517_f61d6d07095460977056db1b5f848fdc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_f61d6d07095460977056db1b5f848fdc.jpg already downloaded
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F90%252F309016f65ae9362b42b4d55268c1feca%252Fpa%252FFN16517_dfa2028e014977d87f025da760dad395.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_dfa2028e014977d87f025da760dad395.jpg already downloaded
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F90%252F309016f65ae9362b42b4d55268c1feca%252Fpa%252FFN16517_fd726a8c282246d4cc52f04c57b0b061.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_fd726a8c282246d4cc52f04c57b0b061.jpg already downloaded
2026-03-27 11:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a90caf3-f8a5-56c6-9be0-336444f5ad60, identifier: FN16517
2026-03-27 11:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 392a769e-bb78-5699-a29f-f5922d2d40b0 with identifier: MC66522
2026-03-27 11:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 392a769e-bb78-5699-a29f-f5922d2d40b0 with scrape type 1
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 392a769e-bb78-5699-a29f-f5922d2d40b0
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_0c0f4015bcec02c6a92174b203dca44b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_0c0f4015bcec02c6a92174b203dca44b.jpg not downloaded yet
2026-03-27 11:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b34550>
2026-03-27 11:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_da9b409de6e94a3b91b59b0c241d7080.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_da9b409de6e94a3b91b59b0c241d7080.jpg saved to cache
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df457952-461f-5c61-b3da-6896d1814d49
2026-03-27 11:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b27590>
2026-03-27 11:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_dd347c8378285baae51e7736b016e4a7.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_dd347c8378285baae51e7736b016e4a7.jpg saved to cache
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa5cf44f-85cf-574c-9a6a-af491c81ab86
2026-03-27 11:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b1bb90>
2026-03-27 11:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_af49eb9a750d17f362a9f1de9eb41a7d.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_af49eb9a750d17f362a9f1de9eb41a7d.jpg saved to cache
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e537b69b-6ce4-5e73-9c9e-7817832184b8
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_9752202dadf81e5bc37d214ff2e75cef.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_9752202dadf81e5bc37d214ff2e75cef.jpg not downloaded yet
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_f8a73facb064193da5bbf334ffc8b76c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_f8a73facb064193da5bbf334ffc8b76c.jpg not downloaded yet
2026-03-27 11:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5da83eef-9ce5-50b7-b5f9-8652db35b71c with identifier: GF63829
2026-03-27 11:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5da83eef-9ce5-50b7-b5f9-8652db35b71c with identifier: GF63829
2026-03-27 11:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5da83eef-9ce5-50b7-b5f9-8652db35b71c with identifier: GF63829 to the API
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GF63829>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:36:44Z',
 'fuel_type': 'diesel',
 'id': '5da83eef-9ce5-50b7-b5f9-8652db35b71c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF63829',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 201432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_b4ba62cd45f9f174e194d8bc11db0a96.jpg',
                'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_ecaf81e3b550c989a660f5897aebcf04.jpg',
                'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_9ff864df068f783c4115cf5b645b3232.jpg',
                'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_12cf499d52da0d84eda50673955b4e20.jpg',
                'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_2f65002e64de8aef0fc8933569f097fc.jpg',
                'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_8b181c67cf50c49a02b53b19c485ea3a.jpg',
                'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_cdc27b66d5a009a2e17a4fef11814068.jpg',
                'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_fa1d48fc5758a6f415d36eb6a660eacc.jpg',
                'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_9dbe10773c7706dfacde5b61d99e50db.jpg',
                'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_5a27978c2c49e6bf258657368d933798.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da83eef-9ce5-50b7-b5f9-8652db35b71c/5da83eef-9ce5-50b7-b5f9-8652db35b71c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2274085,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_b4ba62cd45f9f174e194d8bc11db0a96.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da83eef-9ce5-50b7-b5f9-8652db35b71c/5da83eef-9ce5-50b7-b5f9-8652db35b71c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2524843,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_ecaf81e3b550c989a660f5897aebcf04.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da83eef-9ce5-50b7-b5f9-8652db35b71c/5da83eef-9ce5-50b7-b5f9-8652db35b71c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2451638,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_9ff864df068f783c4115cf5b645b3232.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da83eef-9ce5-50b7-b5f9-8652db35b71c/5da83eef-9ce5-50b7-b5f9-8652db35b71c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2670814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_12cf499d52da0d84eda50673955b4e20.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da83eef-9ce5-50b7-b5f9-8652db35b71c/5da83eef-9ce5-50b7-b5f9-8652db35b71c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2146674,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_2f65002e64de8aef0fc8933569f097fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da83eef-9ce5-50b7-b5f9-8652db35b71c/5da83eef-9ce5-50b7-b5f9-8652db35b71c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2300297,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_8b181c67cf50c49a02b53b19c485ea3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da83eef-9ce5-50b7-b5f9-8652db35b71c/5da83eef-9ce5-50b7-b5f9-8652db35b71c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2306113,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_cdc27b66d5a009a2e17a4fef11814068.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da83eef-9ce5-50b7-b5f9-8652db35b71c/5da83eef-9ce5-50b7-b5f9-8652db35b71c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2324666,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_fa1d48fc5758a6f415d36eb6a660eacc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da83eef-9ce5-50b7-b5f9-8652db35b71c/5da83eef-9ce5-50b7-b5f9-8652db35b71c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_9dbe10773c7706dfacde5b61d99e50db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da83eef-9ce5-50b7-b5f9-8652db35b71c/5da83eef-9ce5-50b7-b5f9-8652db35b71c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2263213,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/92/289238e56021a82878efea149fa1d901/pa/GF63829_5a27978c2c49e6bf258657368d933798.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Ocean Race',
 'transmission': 'manual',
 'trim': 'Ocean Race',
 'year': 2015}
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-27 11:30:56 [auto1.be] INFO: Saving data for GF63829: {'created_time': 1774611056.956269, 'last_price_update_time': 1774611056.956282, 'auction_closing_time': 1774715804.0}
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF63829') HTTP/1.1" 204 0
2026-03-27 11:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with identifier: FN16517
2026-03-27 11:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with identifier: FN16517
2026-03-27 11:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with identifier: FN16517 to the API
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FN16517>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:05:49Z',
 'fuel_type': 'diesel',
 'id': '2a90caf3-f8a5-56c6-9be0-336444f5ad60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN16517',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 137494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_11d72804989762602e0ede43eed5396c.jpg',
                'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_92ab3c0843aa5741a2a8507283d850ad.jpg',
                'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_1313aad5b5522d14d626a4f5e08932d0.jpg',
                'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_468c241594ba9a736185345c662214d5.jpg',
                'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_458a5effd49a481b7e9c02efa217868d.jpg',
                'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_376010bd57856ffc2d77f8ea824d01bb.jpg',
                'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_38b3777f04a5ddda5e8b51cf9717e69e.jpg',
                'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_f61d6d07095460977056db1b5f848fdc.jpg',
                'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_dfa2028e014977d87f025da760dad395.jpg',
                'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_fd726a8c282246d4cc52f04c57b0b061.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a90caf3-f8a5-56c6-9be0-336444f5ad60/2a90caf3-f8a5-56c6-9be0-336444f5ad60_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2332849,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_11d72804989762602e0ede43eed5396c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a90caf3-f8a5-56c6-9be0-336444f5ad60/2a90caf3-f8a5-56c6-9be0-336444f5ad60_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2432541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_92ab3c0843aa5741a2a8507283d850ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a90caf3-f8a5-56c6-9be0-336444f5ad60/2a90caf3-f8a5-56c6-9be0-336444f5ad60_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_1313aad5b5522d14d626a4f5e08932d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a90caf3-f8a5-56c6-9be0-336444f5ad60/2a90caf3-f8a5-56c6-9be0-336444f5ad60_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2213901,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_468c241594ba9a736185345c662214d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a90caf3-f8a5-56c6-9be0-336444f5ad60/2a90caf3-f8a5-56c6-9be0-336444f5ad60_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2233452,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_458a5effd49a481b7e9c02efa217868d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a90caf3-f8a5-56c6-9be0-336444f5ad60/2a90caf3-f8a5-56c6-9be0-336444f5ad60_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2326569,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_376010bd57856ffc2d77f8ea824d01bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a90caf3-f8a5-56c6-9be0-336444f5ad60/2a90caf3-f8a5-56c6-9be0-336444f5ad60_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2224096,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_38b3777f04a5ddda5e8b51cf9717e69e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a90caf3-f8a5-56c6-9be0-336444f5ad60/2a90caf3-f8a5-56c6-9be0-336444f5ad60_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_f61d6d07095460977056db1b5f848fdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a90caf3-f8a5-56c6-9be0-336444f5ad60/2a90caf3-f8a5-56c6-9be0-336444f5ad60_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2351937,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_dfa2028e014977d87f025da760dad395.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a90caf3-f8a5-56c6-9be0-336444f5ad60/2a90caf3-f8a5-56c6-9be0-336444f5ad60_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2694780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/90/309016f65ae9362b42b4d55268c1feca/pa/FN16517_fd726a8c282246d4cc52f04c57b0b061.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2014}
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [auto1.be] INFO: Saving data for FN16517: {'created_time': 1774611057.312563, 'last_price_update_time': 1774611057.312573, 'auction_closing_time': 1774713949.0}
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FN16517') HTTP/1.1" 204 0
2026-03-27 11:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_4929f697d7e0450aa40acc2bc46e01bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_c33239db7bbeae5750c12b8386477b70.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_edbb1972e047490f39bc9896cd7d400d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_2a1003795f62d65bbfdd8052985476c6.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_5b57564d034dee547fdd847990f9b86b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_50e457b58cad66e126ec2da29921da4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_50e457b58cad66e126ec2da29921da4c.jpg not downloaded yet
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_978ff192420388e21aeefdf3c297fc53.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_978ff192420388e21aeefdf3c297fc53.jpg not downloaded yet
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_1c9ba2d17e365be5d9cec28cfdd19fac.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_1c9ba2d17e365be5d9cec28cfdd19fac.jpg not downloaded yet
2026-03-27 11:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN56335> (referer: https://www.auto1.com/v1/car-details-view/RN56335/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_7e232261c8f814a41ccbabe6674decac.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_7e232261c8f814a41ccbabe6674decac.jpg not downloaded yet
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_ecbc1ea554eee5a9ce74a361007fcab3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_ecbc1ea554eee5a9ce74a361007fcab3.jpg not downloaded yet
2026-03-27 11:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW76341> (referer: https://www.auto1.com/v1/car-details-view/MW76341/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dddbf5c-4eb8-53ae-8520-608843c459ab with identifier: GW63299
2026-03-27 11:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dddbf5c-4eb8-53ae-8520-608843c459ab with scrape type 1
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3dddbf5c-4eb8-53ae-8520-608843c459ab
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F79%252F437949613951e7992d649be50b3bcaf7%252Fpa%252FGW63299_d46f5aaa1be0fbd8c5536364b927a371.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_d46f5aaa1be0fbd8c5536364b927a371.jpg already downloaded
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F79%252F437949613951e7992d649be50b3bcaf7%252Fpa%252FGW63299_17a971f8af3cd53c29b3558b25bb5f77.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_17a971f8af3cd53c29b3558b25bb5f77.jpg already downloaded
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F79%252F437949613951e7992d649be50b3bcaf7%252Fpa%252FGW63299_7a4fe08beedbe8ca2b5d884df9eea8a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_7a4fe08beedbe8ca2b5d884df9eea8a3.jpg already downloaded
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F79%252F437949613951e7992d649be50b3bcaf7%252Fpa%252FGW63299_4ca241f809f0f4580152b19530ca1d23.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_4ca241f809f0f4580152b19530ca1d23.jpg already downloaded
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F79%252F437949613951e7992d649be50b3bcaf7%252Fpa%252FGW63299_0af0703260feea30eb13074aa6bc19f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_0af0703260feea30eb13074aa6bc19f3.jpg already downloaded
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F79%252F437949613951e7992d649be50b3bcaf7%252Fpa%252FGW63299_345a8e106700f56680f14b54b6d36283.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_345a8e106700f56680f14b54b6d36283.jpg already downloaded
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F79%252F437949613951e7992d649be50b3bcaf7%252Fpa%252FGW63299_94e79904224eddf194395fd8aa79f0ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_94e79904224eddf194395fd8aa79f0ec.jpg already downloaded
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F79%252F437949613951e7992d649be50b3bcaf7%252Fpa%252FGW63299_2861f4fa2a21dd73773511d2aa0f6f16.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_2861f4fa2a21dd73773511d2aa0f6f16.jpg already downloaded
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F79%252F437949613951e7992d649be50b3bcaf7%252Fpa%252FGW63299_bf719092ade18a1319313aa548326bf0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_bf719092ade18a1319313aa548326bf0.jpg already downloaded
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F79%252F437949613951e7992d649be50b3bcaf7%252Fpa%252FGW63299_fc727c566ae1d7cdde0c5f03fd8293d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_fc727c566ae1d7cdde0c5f03fd8293d7.jpg already downloaded
2026-03-27 11:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3dddbf5c-4eb8-53ae-8520-608843c459ab, identifier: GW63299
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_4d29c5f635fe4e7280b47c01430212a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_4d29c5f635fe4e7280b47c01430212a0.jpg not downloaded yet
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_af67e509a2fcf2ee5aaf41aa95d1e487.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_af67e509a2fcf2ee5aaf41aa95d1e487.jpg not downloaded yet
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_030825ba0967a9ed4b9fe1ad901181de.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_030825ba0967a9ed4b9fe1ad901181de.jpg not downloaded yet
2026-03-27 11:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3dddbf5c-4eb8-53ae-8520-608843c459ab with identifier: GW63299
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:30:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3dddbf5c-4eb8-53ae-8520-608843c459ab with identifier: GW63299
2026-03-27 11:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3dddbf5c-4eb8-53ae-8520-608843c459ab with identifier: GW63299 to the API
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GW63299>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:37:31Z',
 'fuel_type': 'petrol',
 'id': '3dddbf5c-4eb8-53ae-8520-608843c459ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW63299',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 118194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_d46f5aaa1be0fbd8c5536364b927a371.jpg',
                'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_17a971f8af3cd53c29b3558b25bb5f77.jpg',
                'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_7a4fe08beedbe8ca2b5d884df9eea8a3.jpg',
                'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_4ca241f809f0f4580152b19530ca1d23.jpg',
                'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_0af0703260feea30eb13074aa6bc19f3.jpg',
                'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_345a8e106700f56680f14b54b6d36283.jpg',
                'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_94e79904224eddf194395fd8aa79f0ec.jpg',
                'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_2861f4fa2a21dd73773511d2aa0f6f16.jpg',
                'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_bf719092ade18a1319313aa548326bf0.jpg',
                'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_fc727c566ae1d7cdde0c5f03fd8293d7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dddbf5c-4eb8-53ae-8520-608843c459ab/3dddbf5c-4eb8-53ae-8520-608843c459ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_d46f5aaa1be0fbd8c5536364b927a371.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dddbf5c-4eb8-53ae-8520-608843c459ab/3dddbf5c-4eb8-53ae-8520-608843c459ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2435670,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_17a971f8af3cd53c29b3558b25bb5f77.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dddbf5c-4eb8-53ae-8520-608843c459ab/3dddbf5c-4eb8-53ae-8520-608843c459ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2291557,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_7a4fe08beedbe8ca2b5d884df9eea8a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dddbf5c-4eb8-53ae-8520-608843c459ab/3dddbf5c-4eb8-53ae-8520-608843c459ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2258055,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_4ca241f809f0f4580152b19530ca1d23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dddbf5c-4eb8-53ae-8520-608843c459ab/3dddbf5c-4eb8-53ae-8520-608843c459ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2200448,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_0af0703260feea30eb13074aa6bc19f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dddbf5c-4eb8-53ae-8520-608843c459ab/3dddbf5c-4eb8-53ae-8520-608843c459ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2245292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_345a8e106700f56680f14b54b6d36283.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dddbf5c-4eb8-53ae-8520-608843c459ab/3dddbf5c-4eb8-53ae-8520-608843c459ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_94e79904224eddf194395fd8aa79f0ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dddbf5c-4eb8-53ae-8520-608843c459ab/3dddbf5c-4eb8-53ae-8520-608843c459ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2382277,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_2861f4fa2a21dd73773511d2aa0f6f16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dddbf5c-4eb8-53ae-8520-608843c459ab/3dddbf5c-4eb8-53ae-8520-608843c459ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2313505,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_bf719092ade18a1319313aa548326bf0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dddbf5c-4eb8-53ae-8520-608843c459ab/3dddbf5c-4eb8-53ae-8520-608843c459ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2388811,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/79/437949613951e7992d649be50b3bcaf7/pa/GW63299_fc727c566ae1d7cdde0c5f03fd8293d7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [auto1.be] INFO: Saving data for GW63299: {'created_time': 1774611058.362266, 'last_price_update_time': 1774611058.362276, 'auction_closing_time': 1774715851.0}
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GW63299') HTTP/1.1" 204 0
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_08dabe6a35bf8f97e0cfc48e3039e663.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_08dabe6a35bf8f97e0cfc48e3039e663.jpg not downloaded yet
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_48567ac0f393fc5e98271736e113be6d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_48567ac0f393fc5e98271736e113be6d.jpg not downloaded yet
2026-03-27 11:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_ec7fa32b6292ee654b464d9708d42baf.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_b5386e822e06e497ae3a3ac912d94f0a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_d14ef56859650bb660f421401255ccf3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_d14ef56859650bb660f421401255ccf3.jpg not downloaded yet
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_133d12e50da04453c20bb71661fd2560.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_133d12e50da04453c20bb71661fd2560.jpg not downloaded yet
2026-03-27 11:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_ee7c2554bd31dd9614f9afc673849c4c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_d313048f3be679e03d724db15a2d3efc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_d313048f3be679e03d724db15a2d3efc.jpg not downloaded yet
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_356775edc41229e40bedacd4a41e4f00.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_356775edc41229e40bedacd4a41e4f00.jpg not downloaded yet
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c77550>
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_4929f697d7e0450aa40acc2bc46e01bf.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_4929f697d7e0450aa40acc2bc46e01bf.jpg saved to cache
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa5cf44f-85cf-574c-9a6a-af491c81ab86
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0cdce50>
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_c33239db7bbeae5750c12b8386477b70.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_c33239db7bbeae5750c12b8386477b70.jpg saved to cache
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e537b69b-6ce4-5e73-9c9e-7817832184b8
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0f2d090>
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_edbb1972e047490f39bc9896cd7d400d.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_edbb1972e047490f39bc9896cd7d400d.jpg saved to cache
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df457952-461f-5c61-b3da-6896d1814d49
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d27350>
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_2a1003795f62d65bbfdd8052985476c6.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_2a1003795f62d65bbfdd8052985476c6.jpg saved to cache
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df457952-461f-5c61-b3da-6896d1814d49
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c73310>
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_5b57564d034dee547fdd847990f9b86b.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_5b57564d034dee547fdd847990f9b86b.jpg saved to cache
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa5cf44f-85cf-574c-9a6a-af491c81ab86
2026-03-27 11:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffa4faba-ccce-55c8-9119-c95e844fbfbe with identifier: RN56335
2026-03-27 11:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffa4faba-ccce-55c8-9119-c95e844fbfbe with scrape type 1
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ffa4faba-ccce-55c8-9119-c95e844fbfbe
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F0f%252F4f0f82d7af5d3eca6f35c1758a047bb3%252Fpa%252FRN56335_7456ba8282bf2d66d3e7d637ba9f41e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_7456ba8282bf2d66d3e7d637ba9f41e1.jpg not downloaded yet
2026-03-27 11:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12f0e405-d36b-5478-8141-bf8484dde994 with identifier: MW76341
2026-03-27 11:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12f0e405-d36b-5478-8141-bf8484dde994 with scrape type 1
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12f0e405-d36b-5478-8141-bf8484dde994
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F3a%252F2c3a082ab63fafb8c04e5f69c9becf79%252Fpa%252FMW76341_e01871c3d0e06e5aa19ff87b9e7cfa09.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_e01871c3d0e06e5aa19ff87b9e7cfa09.jpg already downloaded
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F3a%252F2c3a082ab63fafb8c04e5f69c9becf79%252Fpa%252FMW76341_367c2d3d14b5af2adb2eb46bf4b10586.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_367c2d3d14b5af2adb2eb46bf4b10586.jpg already downloaded
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F3a%252F2c3a082ab63fafb8c04e5f69c9becf79%252Fpa%252FMW76341_f06451f0ac28059be10360d00d763eba.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_f06451f0ac28059be10360d00d763eba.jpg already downloaded
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F3a%252F2c3a082ab63fafb8c04e5f69c9becf79%252Fpa%252FMW76341_a90ca48403039c6c8ad1604afb1e2006.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_a90ca48403039c6c8ad1604afb1e2006.jpg already downloaded
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F3a%252F2c3a082ab63fafb8c04e5f69c9becf79%252Fpa%252FMW76341_68e7b0298f973d90a8192a306c96bf8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_68e7b0298f973d90a8192a306c96bf8e.jpg already downloaded
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F3a%252F2c3a082ab63fafb8c04e5f69c9becf79%252Fpa%252FMW76341_785d855f66c7033ec8ab7e01a3acca27.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_785d855f66c7033ec8ab7e01a3acca27.jpg already downloaded
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F3a%252F2c3a082ab63fafb8c04e5f69c9becf79%252Fpa%252FMW76341_e295dc6085fbe3e43efbc70a59b4568d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_e295dc6085fbe3e43efbc70a59b4568d.jpg already downloaded
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F3a%252F2c3a082ab63fafb8c04e5f69c9becf79%252Fpa%252FMW76341_8052f0614cfe6a6c0b68ec33c5b2fefd.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_8052f0614cfe6a6c0b68ec33c5b2fefd.jpg already downloaded
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F3a%252F2c3a082ab63fafb8c04e5f69c9becf79%252Fpa%252FMW76341_8fa01ba695dfd85b80cc58e1d0f0eae8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_8fa01ba695dfd85b80cc58e1d0f0eae8.jpg already downloaded
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F3a%252F2c3a082ab63fafb8c04e5f69c9becf79%252Fpa%252FMW76341_9d8dc890675ccad7efb59c72e36b5e1b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_9d8dc890675ccad7efb59c72e36b5e1b.jpg already downloaded
2026-03-27 11:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12f0e405-d36b-5478-8141-bf8484dde994, identifier: MW76341
2026-03-27 11:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_f8a73facb064193da5bbf334ffc8b76c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_ee2bab190505d09217cd72d6c43cba56.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_ee2bab190505d09217cd72d6c43cba56.jpg not downloaded yet
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_a7136ddcd7161e1ab9a537a17bb35250.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_a7136ddcd7161e1ab9a537a17bb35250.jpg not downloaded yet
2026-03-27 11:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12f0e405-d36b-5478-8141-bf8484dde994 with identifier: MW76341
2026-03-27 11:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12f0e405-d36b-5478-8141-bf8484dde994 with identifier: MW76341
2026-03-27 11:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12f0e405-d36b-5478-8141-bf8484dde994 with identifier: MW76341 to the API
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MW76341>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:52:17Z',
 'fuel_type': 'petrol',
 'id': '12f0e405-d36b-5478-8141-bf8484dde994',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW76341',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 64488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_e01871c3d0e06e5aa19ff87b9e7cfa09.jpg',
                'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_367c2d3d14b5af2adb2eb46bf4b10586.jpg',
                'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_f06451f0ac28059be10360d00d763eba.jpg',
                'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_a90ca48403039c6c8ad1604afb1e2006.jpg',
                'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_68e7b0298f973d90a8192a306c96bf8e.jpg',
                'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_785d855f66c7033ec8ab7e01a3acca27.jpg',
                'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_e295dc6085fbe3e43efbc70a59b4568d.jpg',
                'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_8052f0614cfe6a6c0b68ec33c5b2fefd.jpg',
                'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_8fa01ba695dfd85b80cc58e1d0f0eae8.jpg',
                'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_9d8dc890675ccad7efb59c72e36b5e1b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f0e405-d36b-5478-8141-bf8484dde994/12f0e405-d36b-5478-8141-bf8484dde994_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_e01871c3d0e06e5aa19ff87b9e7cfa09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f0e405-d36b-5478-8141-bf8484dde994/12f0e405-d36b-5478-8141-bf8484dde994_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_367c2d3d14b5af2adb2eb46bf4b10586.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f0e405-d36b-5478-8141-bf8484dde994/12f0e405-d36b-5478-8141-bf8484dde994_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2734599,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_f06451f0ac28059be10360d00d763eba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f0e405-d36b-5478-8141-bf8484dde994/12f0e405-d36b-5478-8141-bf8484dde994_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2847818,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_a90ca48403039c6c8ad1604afb1e2006.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f0e405-d36b-5478-8141-bf8484dde994/12f0e405-d36b-5478-8141-bf8484dde994_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_68e7b0298f973d90a8192a306c96bf8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f0e405-d36b-5478-8141-bf8484dde994/12f0e405-d36b-5478-8141-bf8484dde994_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_785d855f66c7033ec8ab7e01a3acca27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f0e405-d36b-5478-8141-bf8484dde994/12f0e405-d36b-5478-8141-bf8484dde994_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_e295dc6085fbe3e43efbc70a59b4568d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f0e405-d36b-5478-8141-bf8484dde994/12f0e405-d36b-5478-8141-bf8484dde994_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_8052f0614cfe6a6c0b68ec33c5b2fefd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f0e405-d36b-5478-8141-bf8484dde994/12f0e405-d36b-5478-8141-bf8484dde994_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_8fa01ba695dfd85b80cc58e1d0f0eae8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f0e405-d36b-5478-8141-bf8484dde994/12f0e405-d36b-5478-8141-bf8484dde994_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/3a/2c3a082ab63fafb8c04e5f69c9becf79/pa/MW76341_9d8dc890675ccad7efb59c72e36b5e1b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [auto1.be] INFO: Saving data for MW76341: {'created_time': 1774611059.375446, 'last_price_update_time': 1774611059.375457, 'auction_closing_time': 1774716737.0}
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MW76341') HTTP/1.1" 204 0
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F0f%252F4f0f82d7af5d3eca6f35c1758a047bb3%252Fpa%252FRN56335_4bb6e207c88836acb5f94bb2e35b1c79.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_4bb6e207c88836acb5f94bb2e35b1c79.jpg not downloaded yet
2026-03-27 11:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_9752202dadf81e5bc37d214ff2e75cef.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_844f09e91e1a49dec658f06495915223.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_844f09e91e1a49dec658f06495915223.jpg not downloaded yet
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_842767942dcaa9bd453329185d91f65c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_842767942dcaa9bd453329185d91f65c.jpg not downloaded yet
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6700916990>
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_ec7fa32b6292ee654b464d9708d42baf.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_ec7fa32b6292ee654b464d9708d42baf.jpg saved to cache
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e537b69b-6ce4-5e73-9c9e-7817832184b8
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f2f32050>
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_b5386e822e06e497ae3a3ac912d94f0a.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_b5386e822e06e497ae3a3ac912d94f0a.jpg saved to cache
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e537b69b-6ce4-5e73-9c9e-7817832184b8
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0da2bd0>
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_ee7c2554bd31dd9614f9afc673849c4c.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_ee7c2554bd31dd9614f9afc673849c4c.jpg saved to cache
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9609db3f-592b-5e29-9fc3-b596139b736a
2026-03-27 11:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_24d2778aa305f0fc8a95967f43c63f00.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_0c0f4015bcec02c6a92174b203dca44b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F0f%252F4f0f82d7af5d3eca6f35c1758a047bb3%252Fpa%252FRN56335_b16d75b75d43047f719c90af230951aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_b16d75b75d43047f719c90af230951aa.jpg not downloaded yet
2026-03-27 11:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_c2b8a2a3f37d505618211345e7a38162.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_2c6e02ef55dfd5985e276e00dceec7ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_2c6e02ef55dfd5985e276e00dceec7ce.jpg not downloaded yet
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_b8328dfe6cde17f685602e261bfe2cde.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_b8328dfe6cde17f685602e261bfe2cde.jpg not downloaded yet
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c9f290>
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_f8a73facb064193da5bbf334ffc8b76c.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_f8a73facb064193da5bbf334ffc8b76c.jpg saved to cache
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df457952-461f-5c61-b3da-6896d1814d49
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F0f%252F4f0f82d7af5d3eca6f35c1758a047bb3%252Fpa%252FRN56335_9bbfeaabfe5734d953bd7624f4be1d86.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_9bbfeaabfe5734d953bd7624f4be1d86.jpg not downloaded yet
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_8060d91e5fba21d20b375737ad5c94f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_8060d91e5fba21d20b375737ad5c94f6.jpg not downloaded yet
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_9f4335bad42d9d683c22feab59a5613c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_9f4335bad42d9d683c22feab59a5613c.jpg not downloaded yet
2026-03-27 11:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_cbcaf45ddfc4d023628c8fc908ebf01d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F0f%252F4f0f82d7af5d3eca6f35c1758a047bb3%252Fpa%252FRN56335_097ce2418508221ed94263ac3e7eb3e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_097ce2418508221ed94263ac3e7eb3e2.jpg not downloaded yet
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d14410>
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_9752202dadf81e5bc37d214ff2e75cef.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_9752202dadf81e5bc37d214ff2e75cef.jpg saved to cache
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa5cf44f-85cf-574c-9a6a-af491c81ab86
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d9acd0>
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_24d2778aa305f0fc8a95967f43c63f00.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_24d2778aa305f0fc8a95967f43c63f00.jpg saved to cache
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62ce9160-39cd-5582-a186-21b1728d97d7
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0bac190>
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_0c0f4015bcec02c6a92174b203dca44b.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_0c0f4015bcec02c6a92174b203dca44b.jpg saved to cache
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 392a769e-bb78-5699-a29f-f5922d2d40b0
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d9b410>
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_c2b8a2a3f37d505618211345e7a38162.jpg') HTTP/1.1" 204 0
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_c2b8a2a3f37d505618211345e7a38162.jpg saved to cache
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e537b69b-6ce4-5e73-9c9e-7817832184b8
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_c177d5dcd16cc616e51596a095e4686b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_c177d5dcd16cc616e51596a095e4686b.jpg not downloaded yet
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_89c085bff4ec558ae48c14eb47d60294.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_89c085bff4ec558ae48c14eb47d60294.jpg not downloaded yet
2026-03-27 11:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_48567ac0f393fc5e98271736e113be6d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_08dabe6a35bf8f97e0cfc48e3039e663.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_0023ae283f0c14209e650be1f8ea3cab.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_0023ae283f0c14209e650be1f8ea3cab.jpg not downloaded yet
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_00c115ab9729357c7d5cc27442d3650f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_00c115ab9729357c7d5cc27442d3650f.jpg not downloaded yet
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0f050d0>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_cbcaf45ddfc4d023628c8fc908ebf01d.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_cbcaf45ddfc4d023628c8fc908ebf01d.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df457952-461f-5c61-b3da-6896d1814d49
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_1c9ba2d17e365be5d9cec28cfdd19fac.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET95220> (referer: https://www.auto1.com/v1/car-details-view/ET95220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_6526c6ef993d8bb234a31d3a571a9810.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c3e190>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_48567ac0f393fc5e98271736e113be6d.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_48567ac0f393fc5e98271736e113be6d.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df457952-461f-5c61-b3da-6896d1814d49
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a9db50>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_08dabe6a35bf8f97e0cfc48e3039e663.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_08dabe6a35bf8f97e0cfc48e3039e663.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa5cf44f-85cf-574c-9a6a-af491c81ab86
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_538bc3f29a2c025a7ace546d85ad692a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_844f09e91e1a49dec658f06495915223.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_030825ba0967a9ed4b9fe1ad901181de.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b70f50>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_1c9ba2d17e365be5d9cec28cfdd19fac.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_1c9ba2d17e365be5d9cec28cfdd19fac.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 392a769e-bb78-5699-a29f-f5922d2d40b0
2026-03-27 11:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35b28bc1-1b8a-530f-8c02-1eebb7297e9b with identifier: ET95220
2026-03-27 11:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b with scrape type 1
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_853f49a7414f8bd2be2185d2858c488a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_853f49a7414f8bd2be2185d2858c488a.jpg not downloaded yet
2026-03-27 11:31:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d5ad90>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_6526c6ef993d8bb234a31d3a571a9810.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_6526c6ef993d8bb234a31d3a571a9810.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9609db3f-592b-5e29-9fc3-b596139b736a
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_9bbfeaabfe5734d953bd7624f4be1d86.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_88fc9357d97b941162f3ad7bc0ce7aab.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_88fc9357d97b941162f3ad7bc0ce7aab.jpg not downloaded yet
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_133d12e50da04453c20bb71661fd2560.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_842767942dcaa9bd453329185d91f65c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_a7136ddcd7161e1ab9a537a17bb35250.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_4bb6e207c88836acb5f94bb2e35b1c79.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_876deff955d03afbcbcd5b6e54fcf296.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_d78351e1d70635825b71b3b858ed8a61.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_d78351e1d70635825b71b3b858ed8a61.jpg not downloaded yet
2026-03-27 11:31:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e0c990>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_538bc3f29a2c025a7ace546d85ad692a.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_538bc3f29a2c025a7ace546d85ad692a.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9609db3f-592b-5e29-9fc3-b596139b736a
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d759d0>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_844f09e91e1a49dec658f06495915223.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_844f09e91e1a49dec658f06495915223.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 62ce9160-39cd-5582-a186-21b1728d97d7
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3d05190>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_030825ba0967a9ed4b9fe1ad901181de.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_030825ba0967a9ed4b9fe1ad901181de.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 392a769e-bb78-5699-a29f-f5922d2d40b0
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_0023ae283f0c14209e650be1f8ea3cab.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_09a95224b5d1164dcfceb58d87034d26.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_09a95224b5d1164dcfceb58d87034d26.jpg not downloaded yet
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_c2ff0a36f7dbbfe10e5f16dcd3e70270.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_89c085bff4ec558ae48c14eb47d60294.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_097ce2418508221ed94263ac3e7eb3e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_c177d5dcd16cc616e51596a095e4686b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_00c115ab9729357c7d5cc27442d3650f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX94260> (referer: https://www.auto1.com/v1/car-details-view/UX94260/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_d2880703bdec7e5dfd703503399dedcb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_d2880703bdec7e5dfd703503399dedcb.jpg not downloaded yet
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d753d0>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa4faba-ccce-55c8-9119-c95e844fbfbe/ffa4faba-ccce-55c8-9119-c95e844fbfbe_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F0f%252F4f0f82d7af5d3eca6f35c1758a047bb3%252Fpa%252FRN56335_9bbfeaabfe5734d953bd7624f4be1d86.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_9bbfeaabfe5734d953bd7624f4be1d86.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffa4faba-ccce-55c8-9119-c95e844fbfbe
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d76b90>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_133d12e50da04453c20bb71661fd2560.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_133d12e50da04453c20bb71661fd2560.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 392a769e-bb78-5699-a29f-f5922d2d40b0
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0cbbe90>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_842767942dcaa9bd453329185d91f65c.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_842767942dcaa9bd453329185d91f65c.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 392a769e-bb78-5699-a29f-f5922d2d40b0
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3d37e50>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_a7136ddcd7161e1ab9a537a17bb35250.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_a7136ddcd7161e1ab9a537a17bb35250.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 392a769e-bb78-5699-a29f-f5922d2d40b0
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0dc01d0>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa4faba-ccce-55c8-9119-c95e844fbfbe/ffa4faba-ccce-55c8-9119-c95e844fbfbe_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F0f%252F4f0f82d7af5d3eca6f35c1758a047bb3%252Fpa%252FRN56335_4bb6e207c88836acb5f94bb2e35b1c79.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_4bb6e207c88836acb5f94bb2e35b1c79.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffa4faba-ccce-55c8-9119-c95e844fbfbe
2026-03-27 11:31:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0cf9cd0>
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_876deff955d03afbcbcd5b6e54fcf296.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_876deff955d03afbcbcd5b6e54fcf296.jpg saved to cache
2026-03-27 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df457952-461f-5c61-b3da-6896d1814d49
2026-03-27 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_853f49a7414f8bd2be2185d2858c488a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_aa58dad561506a64fb6d697dba1dc1d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_aa58dad561506a64fb6d697dba1dc1d1.jpg not downloaded yet
2026-03-27 11:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_ee2bab190505d09217cd72d6c43cba56.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_2c6e02ef55dfd5985e276e00dceec7ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_7456ba8282bf2d66d3e7d637ba9f41e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_b16d75b75d43047f719c90af230951aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_8060d91e5fba21d20b375737ad5c94f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_baebae637c3eb11840eb87fe4047a2eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_baebae637c3eb11840eb87fe4047a2eb.jpg not downloaded yet
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0cb80d0>
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_0023ae283f0c14209e650be1f8ea3cab.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_0023ae283f0c14209e650be1f8ea3cab.jpg saved to cache
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 62ce9160-39cd-5582-a186-21b1728d97d7
2026-03-27 11:31:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3d2ae90>
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_c2ff0a36f7dbbfe10e5f16dcd3e70270.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_c2ff0a36f7dbbfe10e5f16dcd3e70270.jpg saved to cache
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa5cf44f-85cf-574c-9a6a-af491c81ab86
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c41cd0>
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_89c085bff4ec558ae48c14eb47d60294.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_89c085bff4ec558ae48c14eb47d60294.jpg saved to cache
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 392a769e-bb78-5699-a29f-f5922d2d40b0
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e03950>
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa4faba-ccce-55c8-9119-c95e844fbfbe/ffa4faba-ccce-55c8-9119-c95e844fbfbe_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F0f%252F4f0f82d7af5d3eca6f35c1758a047bb3%252Fpa%252FRN56335_097ce2418508221ed94263ac3e7eb3e2.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_097ce2418508221ed94263ac3e7eb3e2.jpg saved to cache
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffa4faba-ccce-55c8-9119-c95e844fbfbe
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c30750>
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_c177d5dcd16cc616e51596a095e4686b.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_c177d5dcd16cc616e51596a095e4686b.jpg saved to cache
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 62ce9160-39cd-5582-a186-21b1728d97d7
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e03250>
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_00c115ab9729357c7d5cc27442d3650f.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_00c115ab9729357c7d5cc27442d3650f.jpg saved to cache
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 392a769e-bb78-5699-a29f-f5922d2d40b0
2026-03-27 11:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bac25ec6-cc54-594b-abd2-706436b33277 with identifier: UX94260
2026-03-27 11:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bac25ec6-cc54-594b-abd2-706436b33277 with scrape type 1
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bac25ec6-cc54-594b-abd2-706436b33277
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_7e5e5fe36b644901ec415d46fb021bb7.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_7e5e5fe36b644901ec415d46fb021bb7.jpg not downloaded yet
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_2c66ce7604a9144eb2da3a602edc1c05.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_2c66ce7604a9144eb2da3a602edc1c05.jpg not downloaded yet
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_3984fdfbe5e25aaa3e0daea9ccf54092.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_3984fdfbe5e25aaa3e0daea9ccf54092.jpg not downloaded yet
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3d29d50>
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_853f49a7414f8bd2be2185d2858c488a.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_853f49a7414f8bd2be2185d2858c488a.jpg saved to cache
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d80c50>
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_ee2bab190505d09217cd72d6c43cba56.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_ee2bab190505d09217cd72d6c43cba56.jpg saved to cache
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 62ce9160-39cd-5582-a186-21b1728d97d7
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3d36c50>
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_2c6e02ef55dfd5985e276e00dceec7ce.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_2c6e02ef55dfd5985e276e00dceec7ce.jpg saved to cache
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 62ce9160-39cd-5582-a186-21b1728d97d7
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0ca53d0>
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa4faba-ccce-55c8-9119-c95e844fbfbe/ffa4faba-ccce-55c8-9119-c95e844fbfbe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F0f%252F4f0f82d7af5d3eca6f35c1758a047bb3%252Fpa%252FRN56335_7456ba8282bf2d66d3e7d637ba9f41e1.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_7456ba8282bf2d66d3e7d637ba9f41e1.jpg saved to cache
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffa4faba-ccce-55c8-9119-c95e844fbfbe
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c47ed0>
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa4faba-ccce-55c8-9119-c95e844fbfbe/ffa4faba-ccce-55c8-9119-c95e844fbfbe_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F0f%252F4f0f82d7af5d3eca6f35c1758a047bb3%252Fpa%252FRN56335_b16d75b75d43047f719c90af230951aa.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_b16d75b75d43047f719c90af230951aa.jpg saved to cache
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffa4faba-ccce-55c8-9119-c95e844fbfbe
2026-03-27 11:31:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffa4faba-ccce-55c8-9119-c95e844fbfbe, skipping ID generation
2026-03-27 11:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffa4faba-ccce-55c8-9119-c95e844fbfbe with scrape type 1
2026-03-27 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffa4faba-ccce-55c8-9119-c95e844fbfbe sending to next pipeline
2026-03-27 11:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ffa4faba-ccce-55c8-9119-c95e844fbfbe, identifier: RN56335
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0bbdf50>
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_8060d91e5fba21d20b375737ad5c94f6.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_8060d91e5fba21d20b375737ad5c94f6.jpg saved to cache
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 62ce9160-39cd-5582-a186-21b1728d97d7
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_39c727b1e9d7f7595e31cf1b397c94d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_39c727b1e9d7f7595e31cf1b397c94d6.jpg not downloaded yet
2026-03-27 11:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ffa4faba-ccce-55c8-9119-c95e844fbfbe with identifier: RN56335
2026-03-27 11:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ffa4faba-ccce-55c8-9119-c95e844fbfbe with identifier: RN56335
2026-03-27 11:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ffa4faba-ccce-55c8-9119-c95e844fbfbe with identifier: RN56335 to the API
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_b16d75b75d43047f719c90af230951aa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:23:12Z',
 'fuel_type': 'petrol',
 'id': 'ffa4faba-ccce-55c8-9119-c95e844fbfbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN56335',
 'listing': 'auction',
 'location': 'BE, Strépy Bracquegnies (La Louviere)',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 105536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa4faba-ccce-55c8-9119-c95e844fbfbe/ffa4faba-ccce-55c8-9119-c95e844fbfbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_7456ba8282bf2d66d3e7d637ba9f41e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa4faba-ccce-55c8-9119-c95e844fbfbe/ffa4faba-ccce-55c8-9119-c95e844fbfbe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_4bb6e207c88836acb5f94bb2e35b1c79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa4faba-ccce-55c8-9119-c95e844fbfbe/ffa4faba-ccce-55c8-9119-c95e844fbfbe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_b16d75b75d43047f719c90af230951aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa4faba-ccce-55c8-9119-c95e844fbfbe/ffa4faba-ccce-55c8-9119-c95e844fbfbe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_9bbfeaabfe5734d953bd7624f4be1d86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa4faba-ccce-55c8-9119-c95e844fbfbe/ffa4faba-ccce-55c8-9119-c95e844fbfbe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/0f/4f0f82d7af5d3eca6f35c1758a047bb3/pa/RN56335_097ce2418508221ed94263ac3e7eb3e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-27 11:31:02 [auto1.be] INFO: Saving data for RN56335: {'created_time': 1774611062.534552, 'last_price_update_time': 1774611062.534564, 'auction_closing_time': 1774714992.0}
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RN56335') HTTP/1.1" 204 0
2026-03-27 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_aa58dad561506a64fb6d697dba1dc1d1.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_d2880703bdec7e5dfd703503399dedcb.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_d78351e1d70635825b71b3b858ed8a61.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_09a95224b5d1164dcfceb58d87034d26.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_88fc9357d97b941162f3ad7bc0ce7aab.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_356775edc41229e40bedacd4a41e4f00.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_e22c8241f054b748ced452ffef467399.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_e22c8241f054b748ced452ffef467399.jpg not downloaded yet
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_d7539b089573ab726e36e8974f51fc1d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_d7539b089573ab726e36e8974f51fc1d.jpg not downloaded yet
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_06c98d758ace28ace0448b335189e498.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_06c98d758ace28ace0448b335189e498.jpg not downloaded yet
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_c3453d3788226390f0f7c9602593ebe9.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_c3453d3788226390f0f7c9602593ebe9.jpg not downloaded yet
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_26b83ebaf5a21e926d4da3a5e4177e17.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_26b83ebaf5a21e926d4da3a5e4177e17.jpg not downloaded yet
2026-03-27 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_ecbc1ea554eee5a9ce74a361007fcab3.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_d14ef56859650bb660f421401255ccf3.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_f8f610ab8137cac5820e06c71a538381.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_f8f610ab8137cac5820e06c71a538381.jpg not downloaded yet
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_011f557e7f1c465ba5e71f712d6a6ae9.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_011f557e7f1c465ba5e71f712d6a6ae9.jpg not downloaded yet
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b19090>
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_aa58dad561506a64fb6d697dba1dc1d1.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_aa58dad561506a64fb6d697dba1dc1d1.jpg saved to cache
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0eef210>
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_d2880703bdec7e5dfd703503399dedcb.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_d2880703bdec7e5dfd703503399dedcb.jpg saved to cache
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b7efd0>
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_d78351e1d70635825b71b3b858ed8a61.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_d78351e1d70635825b71b3b858ed8a61.jpg saved to cache
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a9b310>
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_09a95224b5d1164dcfceb58d87034d26.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_09a95224b5d1164dcfceb58d87034d26.jpg saved to cache
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b7c690>
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_88fc9357d97b941162f3ad7bc0ce7aab.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_88fc9357d97b941162f3ad7bc0ce7aab.jpg saved to cache
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0eeda90>
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_356775edc41229e40bedacd4a41e4f00.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_356775edc41229e40bedacd4a41e4f00.jpg saved to cache
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df457952-461f-5c61-b3da-6896d1814d49
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_6a4bc84d611f0f02b72d9f1a0b68a245.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_6a4bc84d611f0f02b72d9f1a0b68a245.jpg not downloaded yet
2026-03-27 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_50e457b58cad66e126ec2da29921da4c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_4d29c5f635fe4e7280b47c01430212a0.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_7e232261c8f814a41ccbabe6674decac.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_af67e509a2fcf2ee5aaf41aa95d1e487.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_978ff192420388e21aeefdf3c297fc53.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_f12cb9981173273e45e40b0b45ee242d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_f12cb9981173273e45e40b0b45ee242d.jpg not downloaded yet
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f3023250>
2026-03-27 11:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_ecbc1ea554eee5a9ce74a361007fcab3.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_ecbc1ea554eee5a9ce74a361007fcab3.jpg saved to cache
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df457952-461f-5c61-b3da-6896d1814d49
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0ac1450>
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_d14ef56859650bb660f421401255ccf3.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_d14ef56859650bb660f421401255ccf3.jpg saved to cache
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 62ce9160-39cd-5582-a186-21b1728d97d7
2026-03-27 11:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_7e5e5fe36b644901ec415d46fb021bb7.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_3984fdfbe5e25aaa3e0daea9ccf54092.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c8b210>
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_50e457b58cad66e126ec2da29921da4c.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_50e457b58cad66e126ec2da29921da4c.jpg saved to cache
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e537b69b-6ce4-5e73-9c9e-7817832184b8
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a6d010>
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_4d29c5f635fe4e7280b47c01430212a0.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_4d29c5f635fe4e7280b47c01430212a0.jpg saved to cache
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e537b69b-6ce4-5e73-9c9e-7817832184b8
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c30090>
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_7e232261c8f814a41ccbabe6674decac.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_7e232261c8f814a41ccbabe6674decac.jpg saved to cache
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa5cf44f-85cf-574c-9a6a-af491c81ab86
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0da3290>
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_af67e509a2fcf2ee5aaf41aa95d1e487.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_af67e509a2fcf2ee5aaf41aa95d1e487.jpg saved to cache
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 62ce9160-39cd-5582-a186-21b1728d97d7
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d2ba10>
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fbc%252F89bcf10362e97be16f46c43572c0efee%252Fpa%252FKW38150_978ff192420388e21aeefdf3c297fc53.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_978ff192420388e21aeefdf3c297fc53.jpg saved to cache
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 62ce9160-39cd-5582-a186-21b1728d97d7
2026-03-27 11:31:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62ce9160-39cd-5582-a186-21b1728d97d7, skipping ID generation
2026-03-27 11:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ce9160-39cd-5582-a186-21b1728d97d7 with scrape type 1
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62ce9160-39cd-5582-a186-21b1728d97d7 sending to next pipeline
2026-03-27 11:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 62ce9160-39cd-5582-a186-21b1728d97d7, identifier: KW38150
2026-03-27 11:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 62ce9160-39cd-5582-a186-21b1728d97d7 with identifier: KW38150
2026-03-27 11:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 62ce9160-39cd-5582-a186-21b1728d97d7 with identifier: KW38150
2026-03-27 11:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 62ce9160-39cd-5582-a186-21b1728d97d7 with identifier: KW38150 to the API
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_978ff192420388e21aeefdf3c297fc53.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:35:25Z',
 'fuel_type': 'petrol',
 'id': '62ce9160-39cd-5582-a186-21b1728d97d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW38150',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 154345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_24d2778aa305f0fc8a95967f43c63f00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_978ff192420388e21aeefdf3c297fc53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_af67e509a2fcf2ee5aaf41aa95d1e487.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_d14ef56859650bb660f421401255ccf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_ee2bab190505d09217cd72d6c43cba56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_844f09e91e1a49dec658f06495915223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_2c6e02ef55dfd5985e276e00dceec7ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_8060d91e5fba21d20b375737ad5c94f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_c177d5dcd16cc616e51596a095e4686b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce9160-39cd-5582-a186-21b1728d97d7/62ce9160-39cd-5582-a186-21b1728d97d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/bc/89bcf10362e97be16f46c43572c0efee/pa/KW38150_0023ae283f0c14209e650be1f8ea3cab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-27 11:31:03 [auto1.be] INFO: Saving data for KW38150: {'created_time': 1774611063.775505, 'last_price_update_time': 1774611063.775514, 'auction_closing_time': 1774715725.0}
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW38150') HTTP/1.1" 204 0
2026-03-27 11:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_2c66ce7604a9144eb2da3a602edc1c05.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_26b83ebaf5a21e926d4da3a5e4177e17.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_baebae637c3eb11840eb87fe4047a2eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_2c7b6f1007b76c75bb8083e33678f445.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_acf38e3a889d9d4fa94613448927f80f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_b8328dfe6cde17f685602e261bfe2cde.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3cfd110>
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_7e5e5fe36b644901ec415d46fb021bb7.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_7e5e5fe36b644901ec415d46fb021bb7.jpg saved to cache
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bac25ec6-cc54-594b-abd2-706436b33277
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e93150>
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_3984fdfbe5e25aaa3e0daea9ccf54092.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_3984fdfbe5e25aaa3e0daea9ccf54092.jpg saved to cache
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bac25ec6-cc54-594b-abd2-706436b33277
2026-03-27 11:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_011f557e7f1c465ba5e71f712d6a6ae9.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0cf6850>
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_2c66ce7604a9144eb2da3a602edc1c05.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_2c66ce7604a9144eb2da3a602edc1c05.jpg saved to cache
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0bd8ad0>
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_26b83ebaf5a21e926d4da3a5e4177e17.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_26b83ebaf5a21e926d4da3a5e4177e17.jpg saved to cache
2026-03-27 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bac25ec6-cc54-594b-abd2-706436b33277
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d28510>
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_baebae637c3eb11840eb87fe4047a2eb.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_baebae637c3eb11840eb87fe4047a2eb.jpg saved to cache
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b
2026-03-27 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_9f4335bad42d9d683c22feab59a5613c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_d7539b089573ab726e36e8974f51fc1d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_f12cb9981173273e45e40b0b45ee242d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_f8f610ab8137cac5820e06c71a538381.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_c3453d3788226390f0f7c9602593ebe9.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0ac00d0>
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8c%252F018c7949c02528baecda6847f18ba45b%252Fpa%252FYL38834_2c7b6f1007b76c75bb8083e33678f445.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_2c7b6f1007b76c75bb8083e33678f445.jpg saved to cache
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df457952-461f-5c61-b3da-6896d1814d49
2026-03-27 11:31:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df457952-461f-5c61-b3da-6896d1814d49, skipping ID generation
2026-03-27 11:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df457952-461f-5c61-b3da-6896d1814d49 with scrape type 1
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df457952-461f-5c61-b3da-6896d1814d49 sending to next pipeline
2026-03-27 11:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: df457952-461f-5c61-b3da-6896d1814d49, identifier: YL38834
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3ccd050>
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_acf38e3a889d9d4fa94613448927f80f.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_acf38e3a889d9d4fa94613448927f80f.jpg saved to cache
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa5cf44f-85cf-574c-9a6a-af491c81ab86
2026-03-27 11:31:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c55250>
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_b8328dfe6cde17f685602e261bfe2cde.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_b8328dfe6cde17f685602e261bfe2cde.jpg saved to cache
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 392a769e-bb78-5699-a29f-f5922d2d40b0
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c899d0>
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_011f557e7f1c465ba5e71f712d6a6ae9.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_011f557e7f1c465ba5e71f712d6a6ae9.jpg saved to cache
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bac25ec6-cc54-594b-abd2-706436b33277
2026-03-27 11:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: df457952-461f-5c61-b3da-6896d1814d49 with identifier: YL38834
2026-03-27 11:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: df457952-461f-5c61-b3da-6896d1814d49 with identifier: YL38834
2026-03-27 11:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: df457952-461f-5c61-b3da-6896d1814d49 with identifier: YL38834 to the API
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_2c7b6f1007b76c75bb8083e33678f445.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:41:43Z',
 'fuel_type': 'petrol',
 'id': 'df457952-461f-5c61-b3da-6896d1814d49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL38834',
 'listing': 'auction',
 'location': 'BE, Strépy Bracquegnies (La Louviere)',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 56823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_da9b409de6e94a3b91b59b0c241d7080.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652527,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_876deff955d03afbcbcd5b6e54fcf296.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_edbb1972e047490f39bc9896cd7d400d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_2a1003795f62d65bbfdd8052985476c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_2c7b6f1007b76c75bb8083e33678f445.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_cbcaf45ddfc4d023628c8fc908ebf01d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_f8a73facb064193da5bbf334ffc8b76c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_ecbc1ea554eee5a9ce74a361007fcab3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_48567ac0f393fc5e98271736e113be6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df457952-461f-5c61-b3da-6896d1814d49/df457952-461f-5c61-b3da-6896d1814d49_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/8c/018c7949c02528baecda6847f18ba45b/pa/YL38834_356775edc41229e40bedacd4a41e4f00.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Roland Garros',
 'transmission': 'manual',
 'trim': 'Roland Garros',
 'year': 2011}
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL38834%27 HTTP/1.1" 200 None
2026-03-27 11:31:04 [auto1.be] INFO: Saving data for YL38834: {'created_time': 1774611064.729052, 'last_price_update_time': 1774611064.729063, 'auction_closing_time': 1774716103.0}
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YL38834') HTTP/1.1" 204 0
2026-03-27 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_39c727b1e9d7f7595e31cf1b397c94d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_f05e8643d02bdfb91c176d9fbee83be5.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_6a4bc84d611f0f02b72d9f1a0b68a245.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_06c98d758ace28ace0448b335189e498.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_e22c8241f054b748ced452ffef467399.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_fc449328b2b7b3c87dc623f946597c89.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3d04790>
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fa7%252F8fa7b8f632e5fdb80d467c5893b14451%252Fpa%252FMC66522_9f4335bad42d9d683c22feab59a5613c.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_9f4335bad42d9d683c22feab59a5613c.jpg saved to cache
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 392a769e-bb78-5699-a29f-f5922d2d40b0
2026-03-27 11:31:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 392a769e-bb78-5699-a29f-f5922d2d40b0, skipping ID generation
2026-03-27 11:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 392a769e-bb78-5699-a29f-f5922d2d40b0 with scrape type 1
2026-03-27 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 392a769e-bb78-5699-a29f-f5922d2d40b0 sending to next pipeline
2026-03-27 11:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 392a769e-bb78-5699-a29f-f5922d2d40b0, identifier: MC66522
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a50b90>
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_d7539b089573ab726e36e8974f51fc1d.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_d7539b089573ab726e36e8974f51fc1d.jpg saved to cache
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c81e90>
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_f12cb9981173273e45e40b0b45ee242d.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_f12cb9981173273e45e40b0b45ee242d.jpg saved to cache
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bac25ec6-cc54-594b-abd2-706436b33277
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0dd1c50>
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_f8f610ab8137cac5820e06c71a538381.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_f8f610ab8137cac5820e06c71a538381.jpg saved to cache
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bac25ec6-cc54-594b-abd2-706436b33277
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c83ed0>
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_c3453d3788226390f0f7c9602593ebe9.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_c3453d3788226390f0f7c9602593ebe9.jpg saved to cache
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bac25ec6-cc54-594b-abd2-706436b33277
2026-03-27 11:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 392a769e-bb78-5699-a29f-f5922d2d40b0 with identifier: MC66522
2026-03-27 11:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 392a769e-bb78-5699-a29f-f5922d2d40b0 with identifier: MC66522
2026-03-27 11:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 392a769e-bb78-5699-a29f-f5922d2d40b0 with identifier: MC66522 to the API
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_9f4335bad42d9d683c22feab59a5613c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:12:28Z',
 'fuel_type': 'diesel',
 'id': '392a769e-bb78-5699-a29f-f5922d2d40b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC66522',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 143399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_0c0f4015bcec02c6a92174b203dca44b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_1c9ba2d17e365be5d9cec28cfdd19fac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_030825ba0967a9ed4b9fe1ad901181de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_133d12e50da04453c20bb71661fd2560.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_a7136ddcd7161e1ab9a537a17bb35250.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_842767942dcaa9bd453329185d91f65c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2088424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_b8328dfe6cde17f685602e261bfe2cde.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2647041,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_9f4335bad42d9d683c22feab59a5613c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_89c085bff4ec558ae48c14eb47d60294.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392a769e-bb78-5699-a29f-f5922d2d40b0/392a769e-bb78-5699-a29f-f5922d2d40b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/a7/8fa7b8f632e5fdb80d467c5893b14451/pa/MC66522_00c115ab9729357c7d5cc27442d3650f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi Comfort Blue 2WD',
 'transmission': 'manual',
 'trim': 'Comfort Blue 2WD',
 'year': 2012}
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-27 11:31:05 [auto1.be] INFO: Saving data for MC66522: {'created_time': 1774611065.508958, 'last_price_update_time': 1774611065.508969, 'auction_closing_time': 1774714348.0}
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MC66522') HTTP/1.1" 204 0
2026-03-27 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_aafde6b16cf9c3af0f773b35432927dc.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_8a44e9a6a7e62bb38ef9b35c098dd642.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KA88762/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b90e10>
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fea%252F92eabb0e0ad05c0522645276b7a8bb0b%252Fpa%252FET95220_39c727b1e9d7f7595e31cf1b397c94d6.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_39c727b1e9d7f7595e31cf1b397c94d6.jpg saved to cache
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b
2026-03-27 11:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35b28bc1-1b8a-530f-8c02-1eebb7297e9b, skipping ID generation
2026-03-27 11:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b with scrape type 1
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b sending to next pipeline
2026-03-27 11:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 35b28bc1-1b8a-530f-8c02-1eebb7297e9b, identifier: ET95220
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c8a290>
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fb7%252F74b78eb3c148679751e7b53f67fb6cc4%252Fpa%252FEP09858_f05e8643d02bdfb91c176d9fbee83be5.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_f05e8643d02bdfb91c176d9fbee83be5.jpg saved to cache
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e537b69b-6ce4-5e73-9c9e-7817832184b8
2026-03-27 11:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e537b69b-6ce4-5e73-9c9e-7817832184b8, skipping ID generation
2026-03-27 11:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e537b69b-6ce4-5e73-9c9e-7817832184b8 with scrape type 1
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e537b69b-6ce4-5e73-9c9e-7817832184b8 sending to next pipeline
2026-03-27 11:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e537b69b-6ce4-5e73-9c9e-7817832184b8, identifier: EP09858
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d61fd0>
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_6a4bc84d611f0f02b72d9f1a0b68a245.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_6a4bc84d611f0f02b72d9f1a0b68a245.jpg saved to cache
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bac25ec6-cc54-594b-abd2-706436b33277
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d618d0>
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_06c98d758ace28ace0448b335189e498.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_06c98d758ace28ace0448b335189e498.jpg saved to cache
2026-03-27 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bac25ec6-cc54-594b-abd2-706436b33277
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3d285d0>
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267cbe41d83b7eba864d433b6b1e3f0%252Fpa%252FUX94260_e22c8241f054b748ced452ffef467399.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_e22c8241f054b748ced452ffef467399.jpg saved to cache
2026-03-27 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bac25ec6-cc54-594b-abd2-706436b33277
2026-03-27 11:31:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bac25ec6-cc54-594b-abd2-706436b33277, skipping ID generation
2026-03-27 11:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bac25ec6-cc54-594b-abd2-706436b33277 with scrape type 1
2026-03-27 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bac25ec6-cc54-594b-abd2-706436b33277 sending to next pipeline
2026-03-27 11:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bac25ec6-cc54-594b-abd2-706436b33277, identifier: UX94260
2026-03-27 11:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0f18290>
2026-03-27 11:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F77%252F2d771a56a529a2dc42d0c661e8271ba2%252Fpa%252FCC17071_fc449328b2b7b3c87dc623f946597c89.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_fc449328b2b7b3c87dc623f946597c89.jpg saved to cache
2026-03-27 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9609db3f-592b-5e29-9fc3-b596139b736a
2026-03-27 11:31:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9609db3f-592b-5e29-9fc3-b596139b736a, skipping ID generation
2026-03-27 11:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9609db3f-592b-5e29-9fc3-b596139b736a with scrape type 1
2026-03-27 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9609db3f-592b-5e29-9fc3-b596139b736a sending to next pipeline
2026-03-27 11:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9609db3f-592b-5e29-9fc3-b596139b736a, identifier: CC17071
2026-03-27 11:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_81c949182b0097b0091eb08db770b9dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_b7bc11083250625e1a9cad2c8b475067.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_626b4e7ca746610f1c717c7947eede05.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_33b058fdbfd3eb6ed3865b48a04d23bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 35b28bc1-1b8a-530f-8c02-1eebb7297e9b with identifier: ET95220
2026-03-27 11:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 35b28bc1-1b8a-530f-8c02-1eebb7297e9b with identifier: ET95220
2026-03-27 11:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 35b28bc1-1b8a-530f-8c02-1eebb7297e9b with identifier: ET95220 to the API
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_39c727b1e9d7f7595e31cf1b397c94d6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:52:42Z',
 'fuel_type': 'petrol',
 'id': '35b28bc1-1b8a-530f-8c02-1eebb7297e9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET95220',
 'listing': 'auction',
 'location': 'BE, Oudenaarde',
 'make': 'BMW',
 'model': '1er',
 'odometer': 184673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_853f49a7414f8bd2be2185d2858c488a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_88fc9357d97b941162f3ad7bc0ce7aab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_d78351e1d70635825b71b3b858ed8a61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_09a95224b5d1164dcfceb58d87034d26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_d2880703bdec7e5dfd703503399dedcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_aa58dad561506a64fb6d697dba1dc1d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_baebae637c3eb11840eb87fe4047a2eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_2c66ce7604a9144eb2da3a602edc1c05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_39c727b1e9d7f7595e31cf1b397c94d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b28bc1-1b8a-530f-8c02-1eebb7297e9b/35b28bc1-1b8a-530f-8c02-1eebb7297e9b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ea/92eabb0e0ad05c0522645276b7a8bb0b/pa/ET95220_d7539b089573ab726e36e8974f51fc1d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 1er 114i',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET95220%27 HTTP/1.1" 200 None
2026-03-27 11:31:06 [auto1.be] INFO: Saving data for ET95220: {'created_time': 1774611066.601549, 'last_price_update_time': 1774611066.60156, 'auction_closing_time': 1774716762.0}
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET95220') HTTP/1.1" 204 0
2026-03-27 11:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e537b69b-6ce4-5e73-9c9e-7817832184b8 with identifier: EP09858
2026-03-27 11:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e537b69b-6ce4-5e73-9c9e-7817832184b8 with identifier: EP09858
2026-03-27 11:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e537b69b-6ce4-5e73-9c9e-7817832184b8 with identifier: EP09858 to the API
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_f05e8643d02bdfb91c176d9fbee83be5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:38:24Z',
 'fuel_type': 'diesel',
 'id': 'e537b69b-6ce4-5e73-9c9e-7817832184b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP09858',
 'listing': 'auction',
 'location': 'BE, Oostende',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 69950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_76bff5f3c792a1171d5fb37f3a0d8d99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_af49eb9a750d17f362a9f1de9eb41a7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_9f8d57b04a25b31c4099b84ca12c8bd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_b5386e822e06e497ae3a3ac912d94f0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_c33239db7bbeae5750c12b8386477b70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_f05e8643d02bdfb91c176d9fbee83be5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_ec7fa32b6292ee654b464d9708d42baf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_c2b8a2a3f37d505618211345e7a38162.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_50e457b58cad66e126ec2da29921da4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e537b69b-6ce4-5e73-9c9e-7817832184b8/e537b69b-6ce4-5e73-9c9e-7817832184b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/b7/74b78eb3c148679751e7b53f67fb6cc4/pa/EP09858_4d29c5f635fe4e7280b47c01430212a0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2016}
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-27 11:31:06 [auto1.be] INFO: Saving data for EP09858: {'created_time': 1774611066.959538, 'last_price_update_time': 1774611066.959549, 'auction_closing_time': 1774715904.0}
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP09858') HTTP/1.1" 204 0
2026-03-27 11:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bac25ec6-cc54-594b-abd2-706436b33277 with identifier: UX94260
2026-03-27 11:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bac25ec6-cc54-594b-abd2-706436b33277 with identifier: UX94260
2026-03-27 11:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bac25ec6-cc54-594b-abd2-706436b33277 with identifier: UX94260 to the API
2026-03-27 11:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_e22c8241f054b748ced452ffef467399.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:59:29Z',
 'fuel_type': 'petrol',
 'id': 'bac25ec6-cc54-594b-abd2-706436b33277',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX94260',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 147506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_7e5e5fe36b644901ec415d46fb021bb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_3984fdfbe5e25aaa3e0daea9ccf54092.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_e22c8241f054b748ced452ffef467399.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_06c98d758ace28ace0448b335189e498.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_c3453d3788226390f0f7c9602593ebe9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_26b83ebaf5a21e926d4da3a5e4177e17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_f8f610ab8137cac5820e06c71a538381.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_011f557e7f1c465ba5e71f712d6a6ae9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_6a4bc84d611f0f02b72d9f1a0b68a245.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bac25ec6-cc54-594b-abd2-706436b33277/bac25ec6-cc54-594b-abd2-706436b33277_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267cbe41d83b7eba864d433b6b1e3f0/pa/UX94260_f12cb9981173273e45e40b0b45ee242d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2016}
2026-03-27 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-27 11:31:07 [auto1.be] INFO: Saving data for UX94260: {'created_time': 1774611067.378808, 'last_price_update_time': 1774611067.37882, 'auction_closing_time': 1774717169.0}
2026-03-27 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UX94260') HTTP/1.1" 204 0
2026-03-27 11:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9609db3f-592b-5e29-9fc3-b596139b736a with identifier: CC17071
2026-03-27 11:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9609db3f-592b-5e29-9fc3-b596139b736a with identifier: CC17071
2026-03-27 11:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9609db3f-592b-5e29-9fc3-b596139b736a with identifier: CC17071 to the API
2026-03-27 11:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_fc449328b2b7b3c87dc623f946597c89.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:49:48Z',
 'fuel_type': 'diesel',
 'id': '9609db3f-592b-5e29-9fc3-b596139b736a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC17071',
 'listing': 'auction',
 'location': 'BE, Tradein',
 'make': 'BMW',
 'model': '3er',
 'odometer': 192640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_d24a65d437af2b1f35e262b1a5eadd6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3121481,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_e87aeccfc7e1eecdfe13301b0c5a84dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2866462,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_2511f7c883fa676ee374b04e6507ee49.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_8ddc28b26c1d8316547cc3eb51cb0735.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_42d967fcf1a4e4964aa77fffa8bbf2af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3036588,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_538bc3f29a2c025a7ace546d85ad692a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_02ad303cbbfa50546bc9246b88aea959.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_fc449328b2b7b3c87dc623f946597c89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_ee7c2554bd31dd9614f9afc673849c4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9609db3f-592b-5e29-9fc3-b596139b736a/9609db3f-592b-5e29-9fc3-b596139b736a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2515499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/77/2d771a56a529a2dc42d0c661e8271ba2/pa/CC17071_6526c6ef993d8bb234a31d3a571a9810.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-27 11:31:08 [auto1.be] INFO: Saving data for CC17071: {'created_time': 1774611068.05205, 'last_price_update_time': 1774611068.052063, 'auction_closing_time': 1774716588.0}
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC17071') HTTP/1.1" 204 0
2026-03-27 11:31:08 [scrapy.extensions.logstats] INFO: Crawled 79 pages (at 79 pages/min), scraped 41 items (at 41 items/min)
2026-03-27 11:31:08 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-27 11:31:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_872f614272969b6884fa6442d7ab6615.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e27ed0>
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_aafde6b16cf9c3af0f773b35432927dc.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_aafde6b16cf9c3af0f773b35432927dc.jpg saved to cache
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a9378dd-2203-5033-8a48-292148cd8edf
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c72f50>
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_8a44e9a6a7e62bb38ef9b35c098dd642.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_8a44e9a6a7e62bb38ef9b35c098dd642.jpg saved to cache
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8013032f-390a-5eea-966f-854d34707c70
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0dcf650>
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_81c949182b0097b0091eb08db770b9dd.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_81c949182b0097b0091eb08db770b9dd.jpg saved to cache
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a9378dd-2203-5033-8a48-292148cd8edf
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0eeca50>
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_b7bc11083250625e1a9cad2c8b475067.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_b7bc11083250625e1a9cad2c8b475067.jpg saved to cache
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a9378dd-2203-5033-8a48-292148cd8edf
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f2d2e5d0>
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_626b4e7ca746610f1c717c7947eede05.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_626b4e7ca746610f1c717c7947eede05.jpg saved to cache
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8013032f-390a-5eea-966f-854d34707c70
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c72290>
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_33b058fdbfd3eb6ed3865b48a04d23bf.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_33b058fdbfd3eb6ed3865b48a04d23bf.jpg saved to cache
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8013032f-390a-5eea-966f-854d34707c70
2026-03-27 11:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_d313048f3be679e03d724db15a2d3efc.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_da44f95ba831edf62317ab90294156ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_ae4b13e9d0e75ee10b27c14cbbbeb03a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_ce2d4f2295f13db566e54fa2c2a62052.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a71250>
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F08%252F86081dcad934bab2d973a47875948135%252Fpa%252FDB11071_872f614272969b6884fa6442d7ab6615.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_872f614272969b6884fa6442d7ab6615.jpg saved to cache
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a9378dd-2203-5033-8a48-292148cd8edf
2026-03-27 11:31:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a9378dd-2203-5033-8a48-292148cd8edf, skipping ID generation
2026-03-27 11:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9378dd-2203-5033-8a48-292148cd8edf with scrape type 1
2026-03-27 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a9378dd-2203-5033-8a48-292148cd8edf sending to next pipeline
2026-03-27 11:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a9378dd-2203-5033-8a48-292148cd8edf, identifier: DB11071
2026-03-27 11:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_f2ccf2abb62282daf49d430d1a8ee985.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a9378dd-2203-5033-8a48-292148cd8edf with identifier: DB11071
2026-03-27 11:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a9378dd-2203-5033-8a48-292148cd8edf with identifier: DB11071
2026-03-27 11:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a9378dd-2203-5033-8a48-292148cd8edf with identifier: DB11071 to the API
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_872f614272969b6884fa6442d7ab6615.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:29:19Z',
 'fuel_type': 'diesel',
 'id': '5a9378dd-2203-5033-8a48-292148cd8edf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB11071',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 89776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 36,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_311903462814993c49ea7113b49e92e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_872f614272969b6884fa6442d7ab6615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_81c949182b0097b0091eb08db770b9dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_87dbf8a5d703b5d0d90ba1826acab3d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_b7bc11083250625e1a9cad2c8b475067.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_cc352601268d5ff2e5e29380e45bae79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_aafde6b16cf9c3af0f773b35432927dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_97c3472e84df74ab20c4ab94506e13c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_fe836d0f7f5f6cf17ec205cd59de0a14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9378dd-2203-5033-8a48-292148cd8edf/5a9378dd-2203-5033-8a48-292148cd8edf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/08/86081dcad934bab2d973a47875948135/pa/DB11071_5ef4e8b3575dbff98284fce03132d5aa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Ocean Race',
 'transmission': 'manual',
 'trim': 'Ocean Race',
 'year': 2015}
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB11071%27 HTTP/1.1" 200 None
2026-03-27 11:31:08 [auto1.be] INFO: Saving data for DB11071: {'created_time': 1774611068.968814, 'last_price_update_time': 1774611068.968826, 'auction_closing_time': 1774715359.0}
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB11071') HTTP/1.1" 204 0
2026-03-27 11:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_08b92fa9a71a1908f3f5ed8d8a04fc73.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0cfd3d0>
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_d313048f3be679e03d724db15a2d3efc.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_d313048f3be679e03d724db15a2d3efc.jpg saved to cache
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa5cf44f-85cf-574c-9a6a-af491c81ab86
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e33550>
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_da44f95ba831edf62317ab90294156ed.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_da44f95ba831edf62317ab90294156ed.jpg saved to cache
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c57ad0>
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_ae4b13e9d0e75ee10b27c14cbbbeb03a.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_ae4b13e9d0e75ee10b27c14cbbbeb03a.jpg saved to cache
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8013032f-390a-5eea-966f-854d34707c70
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0bba9d0>
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_ce2d4f2295f13db566e54fa2c2a62052.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_ce2d4f2295f13db566e54fa2c2a62052.jpg saved to cache
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1
2026-03-27 11:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_f5272e6085306c9742a6a9962d86d06c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_a028b00a3e3087a03500a60d064e0139.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_41c40ab9e605b82f9da6ef02dba58974.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS91211/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT90325/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_73829b0ae7e81eb71b55ed860750d972.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f2f30850>
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6b%252F176b14f4dbefef8525b50c3bceac519e%252Fpa%252FLE55631_f2ccf2abb62282daf49d430d1a8ee985.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_f2ccf2abb62282daf49d430d1a8ee985.jpg saved to cache
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8013032f-390a-5eea-966f-854d34707c70
2026-03-27 11:31:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8013032f-390a-5eea-966f-854d34707c70, skipping ID generation
2026-03-27 11:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8013032f-390a-5eea-966f-854d34707c70 with scrape type 1
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8013032f-390a-5eea-966f-854d34707c70 sending to next pipeline
2026-03-27 11:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8013032f-390a-5eea-966f-854d34707c70, identifier: LE55631
2026-03-27 11:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8013032f-390a-5eea-966f-854d34707c70 with identifier: LE55631
2026-03-27 11:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8013032f-390a-5eea-966f-854d34707c70 with identifier: LE55631
2026-03-27 11:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8013032f-390a-5eea-966f-854d34707c70 with identifier: LE55631 to the API
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_f2ccf2abb62282daf49d430d1a8ee985.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Taxi',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:17:24Z',
 'fuel_type': 'petrol',
 'id': '8013032f-390a-5eea-966f-854d34707c70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE55631',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 98347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_ae4b13e9d0e75ee10b27c14cbbbeb03a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_f2ccf2abb62282daf49d430d1a8ee985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_33b058fdbfd3eb6ed3865b48a04d23bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_ac150ff4d0a3fdbdc0c5fd30cee46ed8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_626b4e7ca746610f1c717c7947eede05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_416e32a10a2e6712d205513955f709fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_8a44e9a6a7e62bb38ef9b35c098dd642.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_2491d1d2a8fee6ddf78025e22ffdaf0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_2a44f450a07ef3bc0d3f57d8b3ecc33c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013032f-390a-5eea-966f-854d34707c70/8013032f-390a-5eea-966f-854d34707c70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/6b/176b14f4dbefef8525b50c3bceac519e/pa/LE55631_b74ded49faff40e61e92fad0abd34e9c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2019}
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-27 11:31:09 [auto1.be] INFO: Saving data for LE55631: {'created_time': 1774611069.779502, 'last_price_update_time': 1774611069.779513, 'auction_closing_time': 1774714644.0}
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE55631') HTTP/1.1" 204 0
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b2ebd0>
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_08b92fa9a71a1908f3f5ed8d8a04fc73.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_08b92fa9a71a1908f3f5ed8d8a04fc73.jpg saved to cache
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0cd7650>
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_f5272e6085306c9742a6a9962d86d06c.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_f5272e6085306c9742a6a9962d86d06c.jpg saved to cache
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c6acd0>
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_a028b00a3e3087a03500a60d064e0139.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_a028b00a3e3087a03500a60d064e0139.jpg saved to cache
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0cd4f50>
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_41c40ab9e605b82f9da6ef02dba58974.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_41c40ab9e605b82f9da6ef02dba58974.jpg saved to cache
2026-03-27 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1
2026-03-27 11:31:09 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1863 | hits on page: 40
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e0ca90>
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f6523e0-a241-5558-8415-d2dc5206accb/6f6523e0-a241-5558-8415-d2dc5206accb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F90%252F4090c477eec740b0e7fc2a0f25e637bb%252Fpa%252FZM54310_73829b0ae7e81eb71b55ed860750d972.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_73829b0ae7e81eb71b55ed860750d972.jpg saved to cache
2026-03-27 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f6523e0-a241-5558-8415-d2dc5206accb
2026-03-27 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_eae761e5fddf86c2b1a1ad4aad1512b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_f514b1d3fd775c9ad891b3d5f9649a33.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_03fcf1e57c46f4cdb64238dbca233537.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:10 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-27 11:31:10 [auto1.be] INFO: Scrape type for MS23670: 1
2026-03-27 11:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:10 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-27 11:31:10 [auto1.be] INFO: Scrape type for DC17534: 1
2026-03-27 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MC44479> (referer: https://www.auto1.com/v1/car-details-view/MC44479/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:10 [auto1.be] INFO: Found listing with ID: RH61674
2026-03-27 11:31:10 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-27 11:31:10 [auto1.be] INFO: Scrape type for EJ45470: 2
2026-03-27 11:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f698588d-2208-571b-89b2-8b3c37f75c1d with identifier: EJ45470
2026-03-27 11:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f698588d-2208-571b-89b2-8b3c37f75c1d with scrape type 2
2026-03-27 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f698588d-2208-571b-89b2-8b3c37f75c1d with scrape type 2
2026-03-27 11:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f698588d-2208-571b-89b2-8b3c37f75c1d, identifier: EJ45470
2026-03-27 11:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f698588d-2208-571b-89b2-8b3c37f75c1d with identifier: EJ45470
2026-03-27 11:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f698588d-2208-571b-89b2-8b3c37f75c1d with identifier: EJ45470
2026-03-27 11:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f698588d-2208-571b-89b2-8b3c37f75c1d with identifier: EJ45470 to the API
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:17:22Z',
 'fuel_type': 'petrol',
 'id': 'f698588d-2208-571b-89b2-8b3c37f75c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ45470',
 'listing': 'auction',
 'make': 'Porsche',
 'model': '911',
 'odometer': 90880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1975-08-27',
 'seller_name': None,
 'title': 'Porsche 911 G-Modell 2.7 Coupe',
 'transmission': 'manual',
 'trim': '2.7 Coupe',
 'year': 1975}
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-27 11:31:10 [auto1.be] INFO: Saving data for EJ45470: {'auction_closing_time': 1774714642.0, 'created_time': 1773921077.804371, 'last_price_update_time': 1774611070.492984}
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EJ45470') HTTP/1.1" 204 0
2026-03-27 11:31:10 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-27 11:31:10 [auto1.be] INFO: Scrape type for TU11660: 2
2026-03-27 11:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with identifier: TU11660
2026-03-27 11:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with scrape type 2
2026-03-27 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with scrape type 2
2026-03-27 11:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b75bf36-de36-5b83-9cc7-5682f55ecc50, identifier: TU11660
2026-03-27 11:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with identifier: TU11660
2026-03-27 11:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with identifier: TU11660
2026-03-27 11:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with identifier: TU11660 to the API
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:08:35Z',
 'fuel_type': 'diesel',
 'id': '1b75bf36-de36-5b83-9cc7-5682f55ecc50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU11660',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 34729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-02',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-27 11:31:11 [auto1.be] INFO: Saving data for TU11660: {'auction_closing_time': 1774714115.0, 'created_time': 1773402051.640117, 'last_price_update_time': 1774611071.078944}
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU11660') HTTP/1.1" 204 0
2026-03-27 11:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KA88762> (referer: https://www.auto1.com/v1/car-details-view/KA88762/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:11 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-27 11:31:11 [auto1.be] INFO: Found listing with ID: JH99432
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH99432%27 HTTP/1.1" 200 None
2026-03-27 11:31:11 [auto1.be] INFO: Scrape type for JH99432: 1
2026-03-27 11:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0dfff10>
2026-03-27 11:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fa6%252Fdca67e787a0bd15b278433ed749fdd64%252Fpa%252FME80219_eae761e5fddf86c2b1a1ad4aad1512b8.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_eae761e5fddf86c2b1a1ad4aad1512b8.jpg saved to cache
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1
2026-03-27 11:31:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 764179fe-4ebf-5953-9878-9ec2c3b72eb1, skipping ID generation
2026-03-27 11:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1 with scrape type 1
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1 sending to next pipeline
2026-03-27 11:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 764179fe-4ebf-5953-9878-9ec2c3b72eb1, identifier: ME80219
2026-03-27 11:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3cb4310>
2026-03-27 11:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f6523e0-a241-5558-8415-d2dc5206accb/6f6523e0-a241-5558-8415-d2dc5206accb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F90%252F4090c477eec740b0e7fc2a0f25e637bb%252Fpa%252FZM54310_f514b1d3fd775c9ad891b3d5f9649a33.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_f514b1d3fd775c9ad891b3d5f9649a33.jpg saved to cache
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f6523e0-a241-5558-8415-d2dc5206accb
2026-03-27 11:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d63a10>
2026-03-27 11:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f6523e0-a241-5558-8415-d2dc5206accb/6f6523e0-a241-5558-8415-d2dc5206accb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F90%252F4090c477eec740b0e7fc2a0f25e637bb%252Fpa%252FZM54310_03fcf1e57c46f4cdb64238dbca233537.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_03fcf1e57c46f4cdb64238dbca233537.jpg saved to cache
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f6523e0-a241-5558-8415-d2dc5206accb
2026-03-27 11:31:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f6523e0-a241-5558-8415-d2dc5206accb, skipping ID generation
2026-03-27 11:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f6523e0-a241-5558-8415-d2dc5206accb with scrape type 1
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f6523e0-a241-5558-8415-d2dc5206accb sending to next pipeline
2026-03-27 11:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6f6523e0-a241-5558-8415-d2dc5206accb, identifier: ZM54310
2026-03-27 11:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4eca24b-c4ad-563a-8208-c53776c7a282 with identifier: MC44479
2026-03-27 11:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4eca24b-c4ad-563a-8208-c53776c7a282 with scrape type 1
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4eca24b-c4ad-563a-8208-c53776c7a282
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F8c%252Fcf8c1c0e2452eb2d6231d1200476557c%252Fpa%252FMC44479_e46cfbfc5f2101fd92f59598ecef45fc.png%27 HTTP/1.1" 200 None
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_e46cfbfc5f2101fd92f59598ecef45fc.png already downloaded
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F8c%252Fcf8c1c0e2452eb2d6231d1200476557c%252Fpa%252FMC44479_6289896f7568c69e4af2e0131684679d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_6289896f7568c69e4af2e0131684679d.jpg already downloaded
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F8c%252Fcf8c1c0e2452eb2d6231d1200476557c%252Fpa%252FMC44479_728c5c10b5b9d3fa76add19a456b2674.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_728c5c10b5b9d3fa76add19a456b2674.jpg already downloaded
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F8c%252Fcf8c1c0e2452eb2d6231d1200476557c%252Fpa%252FMC44479_e39875650c2c306a992ce50a72522f0b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_e39875650c2c306a992ce50a72522f0b.jpg already downloaded
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F8c%252Fcf8c1c0e2452eb2d6231d1200476557c%252Fpa%252FMC44479_464a4110678663132b5d72d12ffbdc42.png%27 HTTP/1.1" 200 None
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_464a4110678663132b5d72d12ffbdc42.png already downloaded
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F8c%252Fcf8c1c0e2452eb2d6231d1200476557c%252Fpa%252FMC44479_82640d5e277d7b410a9f0cf0cf54d78a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_82640d5e277d7b410a9f0cf0cf54d78a.jpg already downloaded
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F8c%252Fcf8c1c0e2452eb2d6231d1200476557c%252Fpa%252FMC44479_aca87223d159bd5a9286fc910e0c916e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_aca87223d159bd5a9286fc910e0c916e.jpg already downloaded
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F8c%252Fcf8c1c0e2452eb2d6231d1200476557c%252Fpa%252FMC44479_0bce79c8896b08278c60ebee1075f0f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_0bce79c8896b08278c60ebee1075f0f8.jpg already downloaded
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F8c%252Fcf8c1c0e2452eb2d6231d1200476557c%252Fpa%252FMC44479_313bba8012730497429c544b163f8424.png%27 HTTP/1.1" 200 None
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_313bba8012730497429c544b163f8424.png already downloaded
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F8c%252Fcf8c1c0e2452eb2d6231d1200476557c%252Fpa%252FMC44479_087c4ce5325d06e27a203f0fd126ca21.png%27 HTTP/1.1" 200 None
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_087c4ce5325d06e27a203f0fd126ca21.png already downloaded
2026-03-27 11:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4eca24b-c4ad-563a-8208-c53776c7a282, identifier: MC44479
2026-03-27 11:31:11 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-27 11:31:11 [auto1.be] INFO: Found listing with ID: PY40839
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY40839%27 HTTP/1.1" 200 None
2026-03-27 11:31:11 [auto1.be] INFO: Scrape type for PY40839: 2
2026-03-27 11:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1e21240-1b44-58dd-835a-320d5a3a7f2b with identifier: PY40839
2026-03-27 11:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e21240-1b44-58dd-835a-320d5a3a7f2b with scrape type 2
2026-03-27 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1e21240-1b44-58dd-835a-320d5a3a7f2b with scrape type 2
2026-03-27 11:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b1e21240-1b44-58dd-835a-320d5a3a7f2b, identifier: PY40839
2026-03-27 11:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC85120> (referer: https://www.auto1.com/v1/car-details-view/SC85120/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 764179fe-4ebf-5953-9878-9ec2c3b72eb1 with identifier: ME80219
2026-03-27 11:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 764179fe-4ebf-5953-9878-9ec2c3b72eb1 with identifier: ME80219
2026-03-27 11:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 764179fe-4ebf-5953-9878-9ec2c3b72eb1 with identifier: ME80219 to the API
2026-03-27 11:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_eae761e5fddf86c2b1a1ad4aad1512b8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:39:52Z',
 'fuel_type': 'diesel',
 'id': '764179fe-4ebf-5953-9878-9ec2c3b72eb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME80219',
 'listing': 'auction',
 'location': 'BE, Seraing',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 143889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3185846,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_c6ac9afd0929c6bb56f16ada18256c13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_8cc1b1d6c90458c4e845aa29abbc2425.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_eae761e5fddf86c2b1a1ad4aad1512b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_41c40ab9e605b82f9da6ef02dba58974.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_66f221bcf3490859ba6979260b2fcfaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_4d0c218299e319546d49880d063a566c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_ca70524f9d774d097e534ce286773171.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_f5272e6085306c9742a6a9962d86d06c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_08b92fa9a71a1908f3f5ed8d8a04fc73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764179fe-4ebf-5953-9878-9ec2c3b72eb1/764179fe-4ebf-5953-9878-9ec2c3b72eb1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/a6/dca67e787a0bd15b278433ed749fdd64/pa/ME80219_ce2d4f2295f13db566e54fa2c2a62052.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-27 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME80219%27 HTTP/1.1" 200 None
2026-03-27 11:31:12 [auto1.be] INFO: Saving data for ME80219: {'created_time': 1774611072.168208, 'last_price_update_time': 1774611072.168218, 'auction_closing_time': 1774715992.0}
2026-03-27 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ME80219') HTTP/1.1" 204 0
2026-03-27 11:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6f6523e0-a241-5558-8415-d2dc5206accb with identifier: ZM54310
2026-03-27 11:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6f6523e0-a241-5558-8415-d2dc5206accb with identifier: ZM54310
2026-03-27 11:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6f6523e0-a241-5558-8415-d2dc5206accb with identifier: ZM54310 to the API
2026-03-27 11:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_03fcf1e57c46f4cdb64238dbca233537.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 88,
 'expiration_date': '2026-03-28T16:45:09Z',
 'fuel_type': 'petrol',
 'id': '6f6523e0-a241-5558-8415-d2dc5206accb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM54310',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 123698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f6523e0-a241-5558-8415-d2dc5206accb/6f6523e0-a241-5558-8415-d2dc5206accb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_fe30b3cf644b7753c2170e8fca8a66b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f6523e0-a241-5558-8415-d2dc5206accb/6f6523e0-a241-5558-8415-d2dc5206accb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_03fcf1e57c46f4cdb64238dbca233537.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f6523e0-a241-5558-8415-d2dc5206accb/6f6523e0-a241-5558-8415-d2dc5206accb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_f514b1d3fd775c9ad891b3d5f9649a33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f6523e0-a241-5558-8415-d2dc5206accb/6f6523e0-a241-5558-8415-d2dc5206accb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_73829b0ae7e81eb71b55ed860750d972.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f6523e0-a241-5558-8415-d2dc5206accb/6f6523e0-a241-5558-8415-d2dc5206accb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/90/4090c477eec740b0e7fc2a0f25e637bb/pa/ZM54310_7928e053f4b2433b970472920c1b558a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 307 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2007}
2026-03-27 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-27 11:31:12 [auto1.be] INFO: Saving data for ZM54310: {'created_time': 1774611072.593123, 'last_price_update_time': 1774611072.593133, 'auction_closing_time': 1774716309.0}
2026-03-27 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM54310') HTTP/1.1" 204 0
2026-03-27 11:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4eca24b-c4ad-563a-8208-c53776c7a282 with identifier: MC44479
2026-03-27 11:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4eca24b-c4ad-563a-8208-c53776c7a282 with identifier: MC44479
2026-03-27 11:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4eca24b-c4ad-563a-8208-c53776c7a282 with identifier: MC44479 to the API
2026-03-27 11:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MC44479>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:47:02Z',
 'fuel_type': 'diesel',
 'id': 'e4eca24b-c4ad-563a-8208-c53776c7a282',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC44479',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 24280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_e46cfbfc5f2101fd92f59598ecef45fc.png',
                'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_6289896f7568c69e4af2e0131684679d.jpg',
                'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_728c5c10b5b9d3fa76add19a456b2674.jpg',
                'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_e39875650c2c306a992ce50a72522f0b.jpg',
                'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_464a4110678663132b5d72d12ffbdc42.png',
                'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_82640d5e277d7b410a9f0cf0cf54d78a.jpg',
                'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_aca87223d159bd5a9286fc910e0c916e.jpg',
                'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_0bce79c8896b08278c60ebee1075f0f8.jpg',
                'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_313bba8012730497429c544b163f8424.png',
                'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_087c4ce5325d06e27a203f0fd126ca21.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4eca24b-c4ad-563a-8208-c53776c7a282/e4eca24b-c4ad-563a-8208-c53776c7a282_image_0.png',
             'Extension': 'png',
             'FileSizeInBytes': 367363,
             'Height': 537,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_e46cfbfc5f2101fd92f59598ecef45fc.png',
             'Width': 776},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4eca24b-c4ad-563a-8208-c53776c7a282/e4eca24b-c4ad-563a-8208-c53776c7a282_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_6289896f7568c69e4af2e0131684679d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4eca24b-c4ad-563a-8208-c53776c7a282/e4eca24b-c4ad-563a-8208-c53776c7a282_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_728c5c10b5b9d3fa76add19a456b2674.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4eca24b-c4ad-563a-8208-c53776c7a282/e4eca24b-c4ad-563a-8208-c53776c7a282_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_e39875650c2c306a992ce50a72522f0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4eca24b-c4ad-563a-8208-c53776c7a282/e4eca24b-c4ad-563a-8208-c53776c7a282_image_4.png',
             'Extension': 'png',
             'FileSizeInBytes': 374458,
             'Height': 567,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_464a4110678663132b5d72d12ffbdc42.png',
             'Width': 767},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4eca24b-c4ad-563a-8208-c53776c7a282/e4eca24b-c4ad-563a-8208-c53776c7a282_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_82640d5e277d7b410a9f0cf0cf54d78a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4eca24b-c4ad-563a-8208-c53776c7a282/e4eca24b-c4ad-563a-8208-c53776c7a282_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_aca87223d159bd5a9286fc910e0c916e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4eca24b-c4ad-563a-8208-c53776c7a282/e4eca24b-c4ad-563a-8208-c53776c7a282_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_0bce79c8896b08278c60ebee1075f0f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4eca24b-c4ad-563a-8208-c53776c7a282/e4eca24b-c4ad-563a-8208-c53776c7a282_image_8.png',
             'Extension': 'png',
             'FileSizeInBytes': 874033,
             'Height': 572,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_313bba8012730497429c544b163f8424.png',
             'Width': 776},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4eca24b-c4ad-563a-8208-c53776c7a282/e4eca24b-c4ad-563a-8208-c53776c7a282_image_9.png',
             'Extension': 'png',
             'FileSizeInBytes': 898752,
             'Height': 585,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/8c/cf8c1c0e2452eb2d6231d1200476557c/pa/MC44479_087c4ce5325d06e27a203f0fd126ca21.png',
             'Width': 781}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-27 11:31:13 [auto1.be] INFO: Saving data for MC44479: {'created_time': 1774611073.115855, 'last_price_update_time': 1774611073.11587, 'auction_closing_time': 1774716422.0}
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MC44479') HTTP/1.1" 204 0
2026-03-27 11:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b1e21240-1b44-58dd-835a-320d5a3a7f2b with identifier: PY40839
2026-03-27 11:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b1e21240-1b44-58dd-835a-320d5a3a7f2b with identifier: PY40839
2026-03-27 11:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b1e21240-1b44-58dd-835a-320d5a3a7f2b with identifier: PY40839 to the API
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:36Z',
 'fuel_type': 'petrol',
 'id': 'b1e21240-1b44-58dd-835a-320d5a3a7f2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY40839',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 160023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-21',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2022}
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY40839%27 HTTP/1.1" 200 None
2026-03-27 11:31:13 [auto1.be] INFO: Saving data for PY40839: {'auction_closing_time': 1774713636.0, 'created_time': 1773132099.50202, 'last_price_update_time': 1774611073.439725}
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY40839') HTTP/1.1" 204 0
2026-03-27 11:31:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:13 [auto1.be] INFO: Found listing with ID: HL14568
2026-03-27 11:31:13 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-27 11:31:13 [auto1.be] INFO: Scrape type for AV28567: 1
2026-03-27 11:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_8bc5cef8c9a9d4559bc3a0474cb185df.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:13 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-27 11:31:13 [auto1.be] INFO: Found listing with ID: BW89679
2026-03-27 11:31:13 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-27 11:31:13 [auto1.be] INFO: Scrape type for XB17770: 2
2026-03-27 11:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5034336-1fbd-51ae-be60-ec6bb35bdc82 with identifier: XB17770
2026-03-27 11:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5034336-1fbd-51ae-be60-ec6bb35bdc82 with scrape type 2
2026-03-27 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5034336-1fbd-51ae-be60-ec6bb35bdc82 with scrape type 2
2026-03-27 11:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5034336-1fbd-51ae-be60-ec6bb35bdc82, identifier: XB17770
2026-03-27 11:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with identifier: KA88762
2026-03-27 11:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with scrape type 1
2026-03-27 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_9787d457e2b3728d06d66fa9834fd354.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_9787d457e2b3728d06d66fa9834fd354.jpg not downloaded yet
2026-03-27 11:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f350627-37d4-5531-94ae-9eb0c0194e94 with identifier: SC85120
2026-03-27 11:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f350627-37d4-5531-94ae-9eb0c0194e94 with scrape type 1
2026-03-27 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f350627-37d4-5531-94ae-9eb0c0194e94
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_cc039154eaaba8fb98687f10734f4cef.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_cc039154eaaba8fb98687f10734f4cef.jpg not downloaded yet
2026-03-27 11:31:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5034336-1fbd-51ae-be60-ec6bb35bdc82 with identifier: XB17770
2026-03-27 11:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5034336-1fbd-51ae-be60-ec6bb35bdc82 with identifier: XB17770
2026-03-27 11:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5034336-1fbd-51ae-be60-ec6bb35bdc82 with identifier: XB17770 to the API
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-28T16:01:34Z',
 'fuel_type': 'diesel',
 'id': 'c5034336-1fbd-51ae-be60-ec6bb35bdc82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB17770',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 99960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-25',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Momentum Pro AWD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro AWD',
 'year': 2021}
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-27 11:31:13 [auto1.be] INFO: Saving data for XB17770: {'auction_closing_time': 1774713694.0, 'created_time': 1773236499.564429, 'last_price_update_time': 1774611073.994956}
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB17770') HTTP/1.1" 204 0
2026-03-27 11:31:14 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-27 11:31:14 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-27 11:31:14 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-27 11:31:14 [auto1.be] INFO: Scrape type for LP07116: 1
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_af16a0227c625e194f8b677683bcc7d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_af16a0227c625e194f8b677683bcc7d5.jpg not downloaded yet
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_d970844f55b295f8fc5d160975913d4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_d970844f55b295f8fc5d160975913d4b.jpg not downloaded yet
2026-03-27 11:31:14 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-27 11:31:14 [auto1.be] INFO: Scrape type for CE65833: 1
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_6e85c2091cbab92c3e1afe6c2f494b81.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_6e85c2091cbab92c3e1afe6c2f494b81.jpg not downloaded yet
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_342a766ae826052c40d7c99ec3ebd621.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_342a766ae826052c40d7c99ec3ebd621.jpg not downloaded yet
2026-03-27 11:31:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e2b190>
2026-03-27 11:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff4%252Fb4f4a041bb4cdff913e62b750f1c3d9e%252Fpa%252FKH63709_8bc5cef8c9a9d4559bc3a0474cb185df.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_8bc5cef8c9a9d4559bc3a0474cb185df.jpg saved to cache
2026-03-27 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa5cf44f-85cf-574c-9a6a-af491c81ab86
2026-03-27 11:31:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa5cf44f-85cf-574c-9a6a-af491c81ab86, skipping ID generation
2026-03-27 11:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa5cf44f-85cf-574c-9a6a-af491c81ab86 with scrape type 1
2026-03-27 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa5cf44f-85cf-574c-9a6a-af491c81ab86 sending to next pipeline
2026-03-27 11:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aa5cf44f-85cf-574c-9a6a-af491c81ab86, identifier: KH63709
2026-03-27 11:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_cc039154eaaba8fb98687f10734f4cef.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_9787d457e2b3728d06d66fa9834fd354.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:14 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-27 11:31:14 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-27 11:31:14 [auto1.be] INFO: Scrape type for VP78411: 1
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_009f1939bb180d76d3bfe36dc405eb98.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_009f1939bb180d76d3bfe36dc405eb98.jpg not downloaded yet
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_1c6966ae4a13f3531335007375ca5267.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_1c6966ae4a13f3531335007375ca5267.jpg not downloaded yet
2026-03-27 11:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aa5cf44f-85cf-574c-9a6a-af491c81ab86 with identifier: KH63709
2026-03-27 11:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aa5cf44f-85cf-574c-9a6a-af491c81ab86 with identifier: KH63709
2026-03-27 11:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aa5cf44f-85cf-574c-9a6a-af491c81ab86 with identifier: KH63709 to the API
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_8bc5cef8c9a9d4559bc3a0474cb185df.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:49:42Z',
 'fuel_type': 'petrol',
 'id': 'aa5cf44f-85cf-574c-9a6a-af491c81ab86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH63709',
 'listing': 'auction',
 'location': 'BE, Oostende',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 68939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_dd347c8378285baae51e7736b016e4a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2404956,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_c2ff0a36f7dbbfe10e5f16dcd3e70270.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_5b57564d034dee547fdd847990f9b86b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_4929f697d7e0450aa40acc2bc46e01bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2450341,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_8bc5cef8c9a9d4559bc3a0474cb185df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_acf38e3a889d9d4fa94613448927f80f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_9752202dadf81e5bc37d214ff2e75cef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_7e232261c8f814a41ccbabe6674decac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_08dabe6a35bf8f97e0cfc48e3039e663.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5cf44f-85cf-574c-9a6a-af491c81ab86/aa5cf44f-85cf-574c-9a6a-af491c81ab86_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2519292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f4/b4f4a041bb4cdff913e62b750f1c3d9e/pa/KH63709_d313048f3be679e03d724db15a2d3efc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Business 2WD',
 'transmission': 'automatic',
 'trim': 'Business 2WD',
 'year': 2020}
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-27 11:31:14 [auto1.be] INFO: Saving data for KH63709: {'created_time': 1774611074.870131, 'last_price_update_time': 1774611074.870143, 'auction_closing_time': 1774716582.0}
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KH63709') HTTP/1.1" 204 0
2026-03-27 11:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC17534/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:15 [auto1.be] INFO: Found listing with ID: KV58178
2026-03-27 11:31:15 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-27 11:31:15 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-27 11:31:15 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-27 11:31:15 [auto1.be] INFO: Scrape type for HB98543: 2
2026-03-27 11:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c88ce288-a0c0-5486-997d-d0961638670b with identifier: HB98543
2026-03-27 11:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c88ce288-a0c0-5486-997d-d0961638670b with scrape type 2
2026-03-27 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c88ce288-a0c0-5486-997d-d0961638670b with scrape type 2
2026-03-27 11:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c88ce288-a0c0-5486-997d-d0961638670b, identifier: HB98543
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_d106e812f1c2168a0d076a8328ded94a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_d106e812f1c2168a0d076a8328ded94a.jpg not downloaded yet
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_5483511b844eca2670f85da92207885d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_5483511b844eca2670f85da92207885d.jpg not downloaded yet
2026-03-27 11:31:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT90325> (referer: https://www.auto1.com/v1/car-details-view/XT90325/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS91211> (referer: https://www.auto1.com/v1/car-details-view/JS91211/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c88ce288-a0c0-5486-997d-d0961638670b with identifier: HB98543
2026-03-27 11:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c88ce288-a0c0-5486-997d-d0961638670b with identifier: HB98543
2026-03-27 11:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c88ce288-a0c0-5486-997d-d0961638670b with identifier: HB98543 to the API
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:00:12Z',
 'fuel_type': 'diesel',
 'id': 'c88ce288-a0c0-5486-997d-d0961638670b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB98543',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 171169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI 120 Jahre Start/Stop',
 'transmission': 'manual',
 'trim': '120 Jahre Start/Stop',
 'year': 2019}
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-27 11:31:15 [auto1.be] INFO: Saving data for HB98543: {'auction_closing_time': 1774713612.0, 'created_time': 1773693735.531847, 'last_price_update_time': 1774611075.480868}
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HB98543') HTTP/1.1" 204 0
2026-03-27 11:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS23670/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f3026110>
2026-03-27 11:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_cc039154eaaba8fb98687f10734f4cef.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_cc039154eaaba8fb98687f10734f4cef.jpg saved to cache
2026-03-27 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f350627-37d4-5531-94ae-9eb0c0194e94
2026-03-27 11:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c46190>
2026-03-27 11:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_9787d457e2b3728d06d66fa9834fd354.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_9787d457e2b3728d06d66fa9834fd354.jpg saved to cache
2026-03-27 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c
2026-03-27 11:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_4f89fa664723f75ea0b88e83a984e4a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_6e85c2091cbab92c3e1afe6c2f494b81.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_342a766ae826052c40d7c99ec3ebd621.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_af16a0227c625e194f8b677683bcc7d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:15 [auto1.be] INFO: Found listing with ID: JX31629
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX31629%27 HTTP/1.1" 200 None
2026-03-27 11:31:15 [auto1.be] INFO: Scrape type for JX31629: 2
2026-03-27 11:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf with identifier: JX31629
2026-03-27 11:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf with scrape type 2
2026-03-27 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf with scrape type 2
2026-03-27 11:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf, identifier: JX31629
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_b3a6e42ba544e3e4ed1697ef14e5f405.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_b3a6e42ba544e3e4ed1697ef14e5f405.jpg not downloaded yet
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_45191c09727c0eebbd2b39276d8bcf12.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_45191c09727c0eebbd2b39276d8bcf12.jpg not downloaded yet
2026-03-27 11:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_d970844f55b295f8fc5d160975913d4b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf with identifier: JX31629
2026-03-27 11:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf with identifier: JX31629
2026-03-27 11:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf with identifier: JX31629 to the API
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:00:44Z',
 'fuel_type': 'diesel',
 'id': '3efe0c89-cea8-5cd9-b31a-ebb930eb51bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX31629',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 79741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-19',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2014}
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX31629%27 HTTP/1.1" 200 None
2026-03-27 11:31:16 [auto1.be] INFO: Saving data for JX31629: {'auction_closing_time': 1774713644.0, 'created_time': 1774471383.188003, 'last_price_update_time': 1774611076.042852}
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX31629') HTTP/1.1" 204 0
2026-03-27 11:31:16 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1864 | hits on page: 40
2026-03-27 11:31:16 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-27 11:31:16 [auto1.be] INFO: Scrape type for UU07035: 2
2026-03-27 11:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee4c9849-e711-542c-a3e1-3623346b18d0 with identifier: UU07035
2026-03-27 11:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4c9849-e711-542c-a3e1-3623346b18d0 with scrape type 2
2026-03-27 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee4c9849-e711-542c-a3e1-3623346b18d0 with scrape type 2
2026-03-27 11:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee4c9849-e711-542c-a3e1-3623346b18d0, identifier: UU07035
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_94fc214aa21f364d573087815592ac35.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_94fc214aa21f364d573087815592ac35.jpg not downloaded yet
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_b7c128bd0f42a7c338b61a287247915c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_b7c128bd0f42a7c338b61a287247915c.jpg not downloaded yet
2026-03-27 11:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_009f1939bb180d76d3bfe36dc405eb98.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_1c6966ae4a13f3531335007375ca5267.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee4c9849-e711-542c-a3e1-3623346b18d0 with identifier: UU07035
2026-03-27 11:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee4c9849-e711-542c-a3e1-3623346b18d0 with identifier: UU07035
2026-03-27 11:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee4c9849-e711-542c-a3e1-3623346b18d0 with identifier: UU07035 to the API
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:00:39Z',
 'fuel_type': 'petrol',
 'id': 'ee4c9849-e711-542c-a3e1-3623346b18d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU07035',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 204364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-15',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2013}
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-27 11:31:16 [auto1.be] INFO: Saving data for UU07035: {'auction_closing_time': 1774713639.0, 'created_time': 1773693340.499912, 'last_price_update_time': 1774611076.658298}
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UU07035') HTTP/1.1" 204 0
2026-03-27 11:31:16 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-27 11:31:16 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-27 11:31:16 [auto1.be] INFO: Scrape type for DY20434: 2
2026-03-27 11:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with identifier: DY20434
2026-03-27 11:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with scrape type 2
2026-03-27 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with scrape type 2
2026-03-27 11:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4, identifier: DY20434
2026-03-27 11:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV28567/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a43692e3-7ce1-5b7d-86ec-bd984af3288e with identifier: XT90325
2026-03-27 11:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a43692e3-7ce1-5b7d-86ec-bd984af3288e with scrape type 1
2026-03-27 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a43692e3-7ce1-5b7d-86ec-bd984af3288e
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_839519b2c8efcf993904809b29ba017d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_839519b2c8efcf993904809b29ba017d.jpg not downloaded yet
2026-03-27 11:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with identifier: JS91211
2026-03-27 11:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with scrape type 1
2026-03-27 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_c92f4c835203b2b77403657e29053328.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_c92f4c835203b2b77403657e29053328.jpg not downloaded yet
2026-03-27 11:31:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0dcf810>
2026-03-27 11:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F1e%252F2a1eb790f4c03e205bb64ebf9d6e2204%252Fpa%252FKB74591_4f89fa664723f75ea0b88e83a984e4a1.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_4f89fa664723f75ea0b88e83a984e4a1.jpg saved to cache
2026-03-27 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f620c6db-e201-522a-a54b-ed85a09b2f43
2026-03-27 11:31:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f620c6db-e201-522a-a54b-ed85a09b2f43, skipping ID generation
2026-03-27 11:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f620c6db-e201-522a-a54b-ed85a09b2f43 with scrape type 1
2026-03-27 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f620c6db-e201-522a-a54b-ed85a09b2f43 sending to next pipeline
2026-03-27 11:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f620c6db-e201-522a-a54b-ed85a09b2f43, identifier: KB74591
2026-03-27 11:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c679d0>
2026-03-27 11:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_6e85c2091cbab92c3e1afe6c2f494b81.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_6e85c2091cbab92c3e1afe6c2f494b81.jpg saved to cache
2026-03-27 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c
2026-03-27 11:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c48f90>
2026-03-27 11:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_342a766ae826052c40d7c99ec3ebd621.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_342a766ae826052c40d7c99ec3ebd621.jpg saved to cache
2026-03-27 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f350627-37d4-5531-94ae-9eb0c0194e94
2026-03-27 11:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b6a090>
2026-03-27 11:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_af16a0227c625e194f8b677683bcc7d5.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_af16a0227c625e194f8b677683bcc7d5.jpg saved to cache
2026-03-27 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c
2026-03-27 11:31:17 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-27 11:31:17 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-27 11:31:17 [auto1.be] INFO: Scrape type for YK80434: 1
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_0f2b3dc54bebfa674bc0e46e11fba3e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_0f2b3dc54bebfa674bc0e46e11fba3e5.jpg not downloaded yet
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_a196ceae5a09fae82f24ed7fb05030e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_a196ceae5a09fae82f24ed7fb05030e2.jpg not downloaded yet
2026-03-27 11:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with identifier: DY20434
2026-03-27 11:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with identifier: DY20434
2026-03-27 11:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with identifier: DY20434 to the API
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:29:21Z',
 'fuel_type': 'petrol',
 'id': 'e80a2ae7-c135-5e4f-9d8c-521e8283a6c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY20434',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 62028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Crossway',
 'transmission': 'automatic',
 'trim': 'Crossway',
 'year': 2018}
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-27 11:31:17 [auto1.be] INFO: Saving data for DY20434: {'auction_closing_time': 1774715361.0, 'created_time': 1773134852.990224, 'last_price_update_time': 1774611077.539595}
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY20434') HTTP/1.1" 204 0
2026-03-27 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH99432/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f620c6db-e201-522a-a54b-ed85a09b2f43 with identifier: KB74591
2026-03-27 11:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f620c6db-e201-522a-a54b-ed85a09b2f43 with identifier: KB74591
2026-03-27 11:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f620c6db-e201-522a-a54b-ed85a09b2f43 with identifier: KB74591 to the API
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_4f89fa664723f75ea0b88e83a984e4a1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:25:28Z',
 'fuel_type': 'diesel',
 'id': 'f620c6db-e201-522a-a54b-ed85a09b2f43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB74591',
 'listing': 'auction',
 'location': 'BE, Rochefort',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 97720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_fdacb2de22a0e6533a627659beffdb2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2620164,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_4f89fa664723f75ea0b88e83a984e4a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_4607038a7d9eba460b37ef6833646e04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_f3b3def6d3cb70bc345389a1d7db5222.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_3fae8620b44e842ecbd859b67529d749.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_dc4b6901a6b6dce5e87e982eb4dae1b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_45622b50c8ac1abbde346e5d4f5298cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_0ebe9a9a3799c4afdc6fc2af0ebc87c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_e67f7f6576c86eeae1cc104e500120df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f620c6db-e201-522a-a54b-ed85a09b2f43/f620c6db-e201-522a-a54b-ed85a09b2f43_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/1e/2a1eb790f4c03e205bb64ebf9d6e2204/pa/KB74591_34dbcbfe0d9e44e1631fb1a73fc23d13.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 xDrive 20d M Sport X',
 'transmission': 'automatic',
 'trim': 'M Sport X',
 'year': 2018}
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB74591%27 HTTP/1.1" 200 None
2026-03-27 11:31:17 [auto1.be] INFO: Saving data for KB74591: {'created_time': 1774611077.90274, 'last_price_update_time': 1774611077.902752, 'auction_closing_time': 1774715128.0}
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KB74591') HTTP/1.1" 204 0
2026-03-27 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_d106e812f1c2168a0d076a8328ded94a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:17 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-27 11:31:17 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-27 11:31:17 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-27 11:31:17 [auto1.be] INFO: Scrape type for JH02802: 2
2026-03-27 11:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5532df08-5d66-51db-a9ec-fec0f4890556 with identifier: JH02802
2026-03-27 11:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5532df08-5d66-51db-a9ec-fec0f4890556 with scrape type 2
2026-03-27 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5532df08-5d66-51db-a9ec-fec0f4890556 with scrape type 2
2026-03-27 11:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5532df08-5d66-51db-a9ec-fec0f4890556, identifier: JH02802
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_e1fb278641755fbe1778f1987bbd3f5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_e1fb278641755fbe1778f1987bbd3f5c.jpg not downloaded yet
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_eb1ab03118e37515d30efeae94832d88.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_eb1ab03118e37515d30efeae94832d88.jpg not downloaded yet
2026-03-27 11:31:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c99710>
2026-03-27 11:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_d970844f55b295f8fc5d160975913d4b.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_d970844f55b295f8fc5d160975913d4b.jpg saved to cache
2026-03-27 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f350627-37d4-5531-94ae-9eb0c0194e94
2026-03-27 11:31:18 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-27 11:31:18 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-27 11:31:18 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-27 11:31:18 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-27 11:31:18 [auto1.be] INFO: Scrape type for GF65026: 0
2026-03-27 11:31:18 [auto1.be] INFO: Found listing with ID: UN53703
2026-03-27 11:31:18 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-27 11:31:18 [auto1.be] INFO: Scrape type for WF76478: 2
2026-03-27 11:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with identifier: WF76478
2026-03-27 11:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with scrape type 2
2026-03-27 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with scrape type 2
2026-03-27 11:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0ab1be6-e265-5fb1-9dbe-7ece245189a2, identifier: WF76478
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_c567a9f894f2dca73dd1e704c46f724a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_c567a9f894f2dca73dd1e704c46f724a.jpg not downloaded yet
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_e455556d6a6b617c5b7c1b2ce4f75918.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_e455556d6a6b617c5b7c1b2ce4f75918.jpg not downloaded yet
2026-03-27 11:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5532df08-5d66-51db-a9ec-fec0f4890556 with identifier: JH02802
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-27 11:31:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5532df08-5d66-51db-a9ec-fec0f4890556 with identifier: JH02802
2026-03-27 11:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5532df08-5d66-51db-a9ec-fec0f4890556 with identifier: JH02802 to the API
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:36:44Z',
 'fuel_type': 'gas',
 'id': '5532df08-5d66-51db-a9ec-fec0f4890556',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH02802',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 258891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TGI Maxi Kasten BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Kasten BlueMotion',
 'year': 2017}
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-27 11:31:18 [auto1.be] INFO: Saving data for JH02802: {'auction_closing_time': 1774715804.0, 'created_time': 1774265461.649245, 'last_price_update_time': 1774611078.701476}
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JH02802') HTTP/1.1" 204 0
2026-03-27 11:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP07116/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0dbf190>
2026-03-27 11:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_009f1939bb180d76d3bfe36dc405eb98.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_009f1939bb180d76d3bfe36dc405eb98.jpg saved to cache
2026-03-27 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c
2026-03-27 11:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3bd1290>
2026-03-27 11:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_1c6966ae4a13f3531335007375ca5267.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_1c6966ae4a13f3531335007375ca5267.jpg saved to cache
2026-03-27 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f350627-37d4-5531-94ae-9eb0c0194e94
2026-03-27 11:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_45191c09727c0eebbd2b39276d8bcf12.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with identifier: WF76478
2026-03-27 11:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with identifier: WF76478
2026-03-27 11:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with identifier: WF76478 to the API
2026-03-27 11:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:12:10Z',
 'fuel_type': 'diesel',
 'id': 'c0ab1be6-e265-5fb1-9dbe-7ece245189a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF76478',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60 Cross Country',
 'odometer': 34223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-04',
 'seller_name': None,
 'title': 'Volvo S60 Cross Country 2.0 D4 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2016}
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-27 11:31:19 [auto1.be] INFO: Saving data for WF76478: {'auction_closing_time': 1774714330.0, 'created_time': 1774298004.937259, 'last_price_update_time': 1774611079.214405}
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WF76478') HTTP/1.1" 204 0
2026-03-27 11:31:19 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-27 11:31:19 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-27 11:31:19 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-27 11:31:19 [auto1.be] INFO: Scrape type for LW38679: 2
2026-03-27 11:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with identifier: LW38679
2026-03-27 11:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with scrape type 2
2026-03-27 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with scrape type 2
2026-03-27 11:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9, identifier: LW38679
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_97adcc73c2be819d7f542151a720cd7f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_97adcc73c2be819d7f542151a720cd7f.jpg not downloaded yet
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_3e17bd4c2e0fde5b1ca766822f85677c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_3e17bd4c2e0fde5b1ca766822f85677c.jpg not downloaded yet
2026-03-27 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_94fc214aa21f364d573087815592ac35.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_b7c128bd0f42a7c338b61a287247915c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_b3a6e42ba544e3e4ed1697ef14e5f405.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:19 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-27 11:31:19 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-27 11:31:19 [auto1.be] INFO: Scrape type for AL21659: 2
2026-03-27 11:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1c24096-f6d3-501f-a13d-66288782ee38 with identifier: AL21659
2026-03-27 11:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1c24096-f6d3-501f-a13d-66288782ee38 with scrape type 2
2026-03-27 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1c24096-f6d3-501f-a13d-66288782ee38 with scrape type 2
2026-03-27 11:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b1c24096-f6d3-501f-a13d-66288782ee38, identifier: AL21659
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_75f8085d6ce43f7af1384751b78bf0c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_75f8085d6ce43f7af1384751b78bf0c4.jpg not downloaded yet
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_8e9e06c377beb2fb3487386c7f86fb98.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_8e9e06c377beb2fb3487386c7f86fb98.jpg not downloaded yet
2026-03-27 11:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with identifier: LW38679
2026-03-27 11:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with identifier: LW38679
2026-03-27 11:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with identifier: LW38679 to the API
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:27:27Z',
 'fuel_type': 'diesel',
 'id': '1b40f512-5bf0-5bfd-8594-c6ae5f4faad9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW38679',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 225826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-23',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.3 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2006}
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-27 11:31:19 [auto1.be] INFO: Saving data for LW38679: {'auction_closing_time': 1774715247.0, 'created_time': 1774125133.712567, 'last_price_update_time': 1774611079.864965}
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LW38679') HTTP/1.1" 204 0
2026-03-27 11:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e9d110>
2026-03-27 11:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_d106e812f1c2168a0d076a8328ded94a.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_d106e812f1c2168a0d076a8328ded94a.jpg saved to cache
2026-03-27 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c
2026-03-27 11:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b1c24096-f6d3-501f-a13d-66288782ee38 with identifier: AL21659
2026-03-27 11:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b1c24096-f6d3-501f-a13d-66288782ee38 with identifier: AL21659
2026-03-27 11:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b1c24096-f6d3-501f-a13d-66288782ee38 with identifier: AL21659 to the API
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:21:21Z',
 'fuel_type': 'petrol',
 'id': 'b1c24096-f6d3-501f-a13d-66288782ee38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL21659',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 130607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-24',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-27 11:31:20 [auto1.be] INFO: Saving data for AL21659: {'auction_closing_time': 1774714881.0, 'created_time': 1773133726.398531, 'last_price_update_time': 1774611080.465626}
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AL21659') HTTP/1.1" 204 0
2026-03-27 11:31:20 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-27 11:31:20 [auto1.be] INFO: Scrape type for MV28568: 2
2026-03-27 11:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0151fb6-a780-53c4-a58c-d924cd3748a0 with identifier: MV28568
2026-03-27 11:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0151fb6-a780-53c4-a58c-d924cd3748a0 with scrape type 2
2026-03-27 11:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0151fb6-a780-53c4-a58c-d924cd3748a0 with scrape type 2
2026-03-27 11:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a0151fb6-a780-53c4-a58c-d924cd3748a0, identifier: MV28568
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_85028ec7c51a0ea086e64e1845f4a14e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_85028ec7c51a0ea086e64e1845f4a14e.jpg not downloaded yet
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_e2697fc4fd9221f21c6857e9deaca504.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_e2697fc4fd9221f21c6857e9deaca504.jpg not downloaded yet
2026-03-27 11:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_c92f4c835203b2b77403657e29053328.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_839519b2c8efcf993904809b29ba017d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:20 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-27 11:31:20 [auto1.be] INFO: Scrape type for SC36479: 1
2026-03-27 11:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a0151fb6-a780-53c4-a58c-d924cd3748a0 with identifier: MV28568
2026-03-27 11:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a0151fb6-a780-53c4-a58c-d924cd3748a0 with identifier: MV28568
2026-03-27 11:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a0151fb6-a780-53c4-a58c-d924cd3748a0 with identifier: MV28568 to the API
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:01:26Z',
 'fuel_type': 'diesel',
 'id': 'a0151fb6-a780-53c4-a58c-d924cd3748a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV28568',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 256854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-20',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-27 11:31:21 [auto1.be] INFO: Saving data for MV28568: {'auction_closing_time': 1774713686.0, 'created_time': 1773132175.677203, 'last_price_update_time': 1774611081.097295}
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MV28568') HTTP/1.1" 204 0
2026-03-27 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE65833/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:21 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-27 11:31:21 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-27 11:31:21 [auto1.be] INFO: Scrape type for DT24627: 2
2026-03-27 11:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with identifier: DT24627
2026-03-27 11:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with scrape type 2
2026-03-27 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with scrape type 2
2026-03-27 11:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9847a40b-2ab2-5564-a7eb-235aebd8ab07, identifier: DT24627
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_4b7f053037250bad7bd740ed7fa4de78.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_4b7f053037250bad7bd740ed7fa4de78.jpg not downloaded yet
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_71c6bd74920b610a9b47eb3839c9ad22.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_71c6bd74920b610a9b47eb3839c9ad22.jpg not downloaded yet
2026-03-27 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP78411/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f3ad3dd0>
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_45191c09727c0eebbd2b39276d8bcf12.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_45191c09727c0eebbd2b39276d8bcf12.jpg saved to cache
2026-03-27 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f350627-37d4-5531-94ae-9eb0c0194e94
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0adaa50>
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_94fc214aa21f364d573087815592ac35.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_94fc214aa21f364d573087815592ac35.jpg saved to cache
2026-03-27 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3ca9c10>
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_b7c128bd0f42a7c338b61a287247915c.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_b7c128bd0f42a7c338b61a287247915c.jpg saved to cache
2026-03-27 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f350627-37d4-5531-94ae-9eb0c0194e94
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3cc1650>
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_b3a6e42ba544e3e4ed1697ef14e5f405.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_b3a6e42ba544e3e4ed1697ef14e5f405.jpg saved to cache
2026-03-27 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c
2026-03-27 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_0f2b3dc54bebfa674bc0e46e11fba3e5.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_a196ceae5a09fae82f24ed7fb05030e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:21 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-27 11:31:21 [auto1.be] INFO: Scrape type for JX62848: 2
2026-03-27 11:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b09b911-677d-5afc-ad0b-4221d98ef428 with identifier: JX62848
2026-03-27 11:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b09b911-677d-5afc-ad0b-4221d98ef428 with scrape type 2
2026-03-27 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b09b911-677d-5afc-ad0b-4221d98ef428 with scrape type 2
2026-03-27 11:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2b09b911-677d-5afc-ad0b-4221d98ef428, identifier: JX62848
2026-03-27 11:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with identifier: DT24627
2026-03-27 11:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with identifier: DT24627
2026-03-27 11:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with identifier: DT24627 to the API
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:23:05Z',
 'fuel_type': 'petrol',
 'id': '9847a40b-2ab2-5564-a7eb-235aebd8ab07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT24627',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 150442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-21',
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2017}
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-27 11:31:21 [auto1.be] INFO: Saving data for DT24627: {'auction_closing_time': 1774714985.0, 'created_time': 1773301634.253162, 'last_price_update_time': 1774611081.944894}
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DT24627') HTTP/1.1" 204 0
2026-03-27 11:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_c567a9f894f2dca73dd1e704c46f724a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_e455556d6a6b617c5b7c1b2ce4f75918.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2b09b911-677d-5afc-ad0b-4221d98ef428 with identifier: JX62848
2026-03-27 11:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2b09b911-677d-5afc-ad0b-4221d98ef428 with identifier: JX62848
2026-03-27 11:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2b09b911-677d-5afc-ad0b-4221d98ef428 with identifier: JX62848 to the API
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:24:31Z',
 'fuel_type': 'diesel',
 'id': '2b09b911-677d-5afc-ad0b-4221d98ef428',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX62848',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 129400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi L2 Sport',
 'transmission': 'automatic',
 'trim': 'L2 Sport',
 'year': 2020}
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-27 11:31:22 [auto1.be] INFO: Saving data for JX62848: {'auction_closing_time': 1774715071.0, 'created_time': 1774297878.045573, 'last_price_update_time': 1774611082.279979}
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX62848') HTTP/1.1" 204 0
2026-03-27 11:31:22 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-27 11:31:22 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-27 11:31:22 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-27 11:31:22 [auto1.be] INFO: Scrape type for RL32581: 0
2026-03-27 11:31:22 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-27 11:31:22 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-27 11:31:22 [auto1.be] INFO: Scrape type for JW58136: 2
2026-03-27 11:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c612b540-cffb-5a85-a102-e56dce025061 with identifier: JW58136
2026-03-27 11:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c612b540-cffb-5a85-a102-e56dce025061 with scrape type 2
2026-03-27 11:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c612b540-cffb-5a85-a102-e56dce025061 with scrape type 2
2026-03-27 11:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c612b540-cffb-5a85-a102-e56dce025061, identifier: JW58136
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_5b49771bafb6c88ead02e07116f7d982.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_5b49771bafb6c88ead02e07116f7d982.jpg not downloaded yet
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_987c10dd7cd87d1db03a8ba02580bbd8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_987c10dd7cd87d1db03a8ba02580bbd8.jpg not downloaded yet
2026-03-27 11:31:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0ca9cd0>
2026-03-27 11:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_c92f4c835203b2b77403657e29053328.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_c92f4c835203b2b77403657e29053328.jpg saved to cache
2026-03-27 11:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba
2026-03-27 11:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3cd62d0>
2026-03-27 11:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_839519b2c8efcf993904809b29ba017d.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_839519b2c8efcf993904809b29ba017d.jpg saved to cache
2026-03-27 11:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a43692e3-7ce1-5b7d-86ec-bd984af3288e
2026-03-27 11:31:22 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-27 11:31:22 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-27 11:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c612b540-cffb-5a85-a102-e56dce025061 with identifier: JW58136
2026-03-27 11:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c612b540-cffb-5a85-a102-e56dce025061 with identifier: JW58136
2026-03-27 11:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c612b540-cffb-5a85-a102-e56dce025061 with identifier: JW58136 to the API
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:35:39Z',
 'fuel_type': 'petrol',
 'id': 'c612b540-cffb-5a85-a102-e56dce025061',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW58136',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 171197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-02',
 'seller_name': None,
 'title': 'Chevrolet Cruze 1.8 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2010}
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-27 11:31:22 [auto1.be] INFO: Saving data for JW58136: {'auction_closing_time': 1774715739.0, 'created_time': 1773135663.676924, 'last_price_update_time': 1774611082.853332}
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW58136') HTTP/1.1" 204 0
2026-03-27 11:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_85028ec7c51a0ea086e64e1845f4a14e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_eb1ab03118e37515d30efeae94832d88.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:22 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-27 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-27 11:31:23 [auto1.be] INFO: Scrape type for DG02903: 2
2026-03-27 11:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a91a79f4-ed15-5009-a9b5-f1581580341f with identifier: DG02903
2026-03-27 11:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91a79f4-ed15-5009-a9b5-f1581580341f with scrape type 2
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a91a79f4-ed15-5009-a9b5-f1581580341f with scrape type 2
2026-03-27 11:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a91a79f4-ed15-5009-a9b5-f1581580341f, identifier: DG02903
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_fa3c840349c5e8b89224e5a07f2752d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_fa3c840349c5e8b89224e5a07f2752d5.jpg not downloaded yet
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_dafbd83891ef8c7351a66b5adeebbde0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_dafbd83891ef8c7351a66b5adeebbde0.jpg not downloaded yet
2026-03-27 11:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC17534> (referer: https://www.auto1.com/v1/car-details-view/DC17534/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_75f8085d6ce43f7af1384751b78bf0c4.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_8e9e06c377beb2fb3487386c7f86fb98.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a91a79f4-ed15-5009-a9b5-f1581580341f with identifier: DG02903
2026-03-27 11:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a91a79f4-ed15-5009-a9b5-f1581580341f with identifier: DG02903
2026-03-27 11:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a91a79f4-ed15-5009-a9b5-f1581580341f with identifier: DG02903 to the API
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:33:11Z',
 'fuel_type': 'diesel',
 'id': 'a91a79f4-ed15-5009-a9b5-f1581580341f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG02903',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 212303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-08',
 'seller_name': None,
 'title': 'BMW 3er 330d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-27 11:31:23 [auto1.be] INFO: Saving data for DG02903: {'auction_closing_time': 1774715591.0, 'created_time': 1773136052.126911, 'last_price_update_time': 1774611083.482185}
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DG02903') HTTP/1.1" 204 0
2026-03-27 11:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0adb490>
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_0f2b3dc54bebfa674bc0e46e11fba3e5.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_0f2b3dc54bebfa674bc0e46e11fba3e5.jpg saved to cache
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c54b50>
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_a196ceae5a09fae82f24ed7fb05030e2.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_a196ceae5a09fae82f24ed7fb05030e2.jpg saved to cache
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f350627-37d4-5531-94ae-9eb0c0194e94
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b872d0>
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_c567a9f894f2dca73dd1e704c46f724a.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_c567a9f894f2dca73dd1e704c46f724a.jpg saved to cache
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a40550>
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_e455556d6a6b617c5b7c1b2ce4f75918.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_e455556d6a6b617c5b7c1b2ce4f75918.jpg saved to cache
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f350627-37d4-5531-94ae-9eb0c0194e94
2026-03-27 11:31:23 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-27 11:31:23 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-27 11:31:23 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-27 11:31:23 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-27 11:31:23 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-27 11:31:23 [auto1.be] INFO: Scrape type for FM00077: 0
2026-03-27 11:31:23 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-27 11:31:23 [auto1.be] INFO: Scrape type for KP74596: 0
2026-03-27 11:31:23 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-27 11:31:23 [auto1.be] INFO: Scrape type for PB67516: 0
2026-03-27 11:31:23 [auto1.be] INFO: Found listing with ID: YJ60132
2026-03-27 11:31:23 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-27 11:31:23 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-27 11:31:23 [auto1.be] INFO: Scrape type for FC28046: 2
2026-03-27 11:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d1dadde-b25e-5539-ac33-ae3b015b70af with identifier: FC28046
2026-03-27 11:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d1dadde-b25e-5539-ac33-ae3b015b70af with scrape type 2
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d1dadde-b25e-5539-ac33-ae3b015b70af with scrape type 2
2026-03-27 11:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d1dadde-b25e-5539-ac33-ae3b015b70af, identifier: FC28046
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_c688465fbfefbae1b7672d2aebdbf6cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_c688465fbfefbae1b7672d2aebdbf6cd.jpg not downloaded yet
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_06bf9e7cac5b60dd38a7e7b40b4337e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_06bf9e7cac5b60dd38a7e7b40b4337e9.jpg not downloaded yet
2026-03-27 11:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d1dadde-b25e-5539-ac33-ae3b015b70af with identifier: FC28046
2026-03-27 11:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d1dadde-b25e-5539-ac33-ae3b015b70af with identifier: FC28046
2026-03-27 11:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d1dadde-b25e-5539-ac33-ae3b015b70af with identifier: FC28046 to the API
2026-03-27 11:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-28T16:25:30Z',
 'fuel_type': 'hybrid',
 'id': '6d1dadde-b25e-5539-ac33-ae3b015b70af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC28046',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 86029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-25',
 'seller_name': None,
 'title': 'Renault Captur 1.6 Hybrid E-Tech Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2022}
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [auto1.be] INFO: Saving data for FC28046: {'auction_closing_time': 1774715130.0, 'created_time': 1773520260.666667, 'last_price_update_time': 1774611084.206847}
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC28046') HTTP/1.1" 204 0
2026-03-27 11:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_71c6bd74920b610a9b47eb3839c9ad22.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:24 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [auto1.be] INFO: Scrape type for GL29646: 2
2026-03-27 11:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96ccd02e-4416-5222-beb2-efe77ba4ccab with identifier: GL29646
2026-03-27 11:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96ccd02e-4416-5222-beb2-efe77ba4ccab with scrape type 2
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96ccd02e-4416-5222-beb2-efe77ba4ccab with scrape type 2
2026-03-27 11:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96ccd02e-4416-5222-beb2-efe77ba4ccab, identifier: GL29646
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_3beacd9493291be70f8b8c609b824c6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_3beacd9493291be70f8b8c609b824c6e.jpg not downloaded yet
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_53e50a10b2acd0c51eab48e2cf3073ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_53e50a10b2acd0c51eab48e2cf3073ff.jpg not downloaded yet
2026-03-27 11:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS23670> (referer: https://www.auto1.com/v1/car-details-view/MS23670/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a987d0>
2026-03-27 11:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_85028ec7c51a0ea086e64e1845f4a14e.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_85028ec7c51a0ea086e64e1845f4a14e.jpg saved to cache
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a43692e3-7ce1-5b7d-86ec-bd984af3288e
2026-03-27 11:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0ca9dd0>
2026-03-27 11:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_eb1ab03118e37515d30efeae94832d88.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_eb1ab03118e37515d30efeae94832d88.jpg saved to cache
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba
2026-03-27 11:31:24 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1864 | hits on page: 40
2026-03-27 11:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with identifier: DC17534
2026-03-27 11:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with scrape type 1
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4debd35f-e5d5-5c62-80d3-2312a6fc1a66
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F03%252Fbb03a665b3054b2dcaef5ea76043d172%252Fpa%252FDC17534_fe96323fa78294bb772ca687211c12c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_fe96323fa78294bb772ca687211c12c3.jpg already downloaded
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F03%252Fbb03a665b3054b2dcaef5ea76043d172%252Fpa%252FDC17534_4b8a78f98c322c2e6f2c6a028332b5d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_4b8a78f98c322c2e6f2c6a028332b5d3.jpg already downloaded
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F03%252Fbb03a665b3054b2dcaef5ea76043d172%252Fpa%252FDC17534_1124c5fbf8a83821dffaf658034d2e59.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_1124c5fbf8a83821dffaf658034d2e59.jpg already downloaded
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F03%252Fbb03a665b3054b2dcaef5ea76043d172%252Fpa%252FDC17534_1859e6bc9963ca7809f03dac0dad09ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_1859e6bc9963ca7809f03dac0dad09ca.jpg already downloaded
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F03%252Fbb03a665b3054b2dcaef5ea76043d172%252Fpa%252FDC17534_99ea747b3ce2763397bb43714c47f204.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_99ea747b3ce2763397bb43714c47f204.jpg already downloaded
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F03%252Fbb03a665b3054b2dcaef5ea76043d172%252Fpa%252FDC17534_ad343c47a44a2fbfd8f99a8aec0c2f30.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_ad343c47a44a2fbfd8f99a8aec0c2f30.jpg already downloaded
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F03%252Fbb03a665b3054b2dcaef5ea76043d172%252Fpa%252FDC17534_e042ac648e1c67e3202c2c80e88868ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_e042ac648e1c67e3202c2c80e88868ad.jpg already downloaded
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F03%252Fbb03a665b3054b2dcaef5ea76043d172%252Fpa%252FDC17534_421178b673e3003cd49ea096955c63e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_421178b673e3003cd49ea096955c63e9.jpg already downloaded
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F03%252Fbb03a665b3054b2dcaef5ea76043d172%252Fpa%252FDC17534_87c8b8db22b27fd6ad37353ce2e6d1b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_87c8b8db22b27fd6ad37353ce2e6d1b0.jpg already downloaded
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F03%252Fbb03a665b3054b2dcaef5ea76043d172%252Fpa%252FDC17534_fb805474729dacaa1f55e704507cb00f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_fb805474729dacaa1f55e704507cb00f.jpg already downloaded
2026-03-27 11:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66, identifier: DC17534
2026-03-27 11:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c59cd0>
2026-03-27 11:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F10%252F1c101cf9b0badb5b3a0b8a42ac10e442%252Fpa%252FKA88762_75f8085d6ce43f7af1384751b78bf0c4.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_75f8085d6ce43f7af1384751b78bf0c4.jpg saved to cache
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c
2026-03-27 11:31:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c, skipping ID generation
2026-03-27 11:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with scrape type 1
2026-03-27 11:31:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c sending to next pipeline
2026-03-27 11:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c, identifier: KA88762
2026-03-27 11:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b08a90>
2026-03-27 11:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_8e9e06c377beb2fb3487386c7f86fb98.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_8e9e06c377beb2fb3487386c7f86fb98.jpg saved to cache
2026-03-27 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f350627-37d4-5531-94ae-9eb0c0194e94
2026-03-27 11:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96ccd02e-4416-5222-beb2-efe77ba4ccab with identifier: GL29646
2026-03-27 11:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96ccd02e-4416-5222-beb2-efe77ba4ccab with identifier: GL29646
2026-03-27 11:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96ccd02e-4416-5222-beb2-efe77ba4ccab with identifier: GL29646 to the API
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:53:40Z',
 'fuel_type': 'diesel',
 'id': '96ccd02e-4416-5222-beb2-efe77ba4ccab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL29646',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 123162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-25',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 111 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2011}
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-27 11:31:25 [auto1.be] INFO: Saving data for GL29646: {'auction_closing_time': 1774716820.0, 'created_time': 1773520431.735694, 'last_price_update_time': 1774611085.407742}
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GL29646') HTTP/1.1" 204 0
2026-03-27 11:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with identifier: DC17534
2026-03-27 11:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with identifier: DC17534
2026-03-27 11:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with identifier: DC17534 to the API
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DC17534>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:07:21Z',
 'fuel_type': 'petrol',
 'id': '4debd35f-e5d5-5c62-80d3-2312a6fc1a66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC17534',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 216832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_fe96323fa78294bb772ca687211c12c3.jpg',
                'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_4b8a78f98c322c2e6f2c6a028332b5d3.jpg',
                'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_1124c5fbf8a83821dffaf658034d2e59.jpg',
                'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_1859e6bc9963ca7809f03dac0dad09ca.jpg',
                'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_99ea747b3ce2763397bb43714c47f204.jpg',
                'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_ad343c47a44a2fbfd8f99a8aec0c2f30.jpg',
                'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_e042ac648e1c67e3202c2c80e88868ad.jpg',
                'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_421178b673e3003cd49ea096955c63e9.jpg',
                'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_87c8b8db22b27fd6ad37353ce2e6d1b0.jpg',
                'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_fb805474729dacaa1f55e704507cb00f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4debd35f-e5d5-5c62-80d3-2312a6fc1a66/4debd35f-e5d5-5c62-80d3-2312a6fc1a66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2111347,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_fe96323fa78294bb772ca687211c12c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4debd35f-e5d5-5c62-80d3-2312a6fc1a66/4debd35f-e5d5-5c62-80d3-2312a6fc1a66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2315137,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_4b8a78f98c322c2e6f2c6a028332b5d3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4debd35f-e5d5-5c62-80d3-2312a6fc1a66/4debd35f-e5d5-5c62-80d3-2312a6fc1a66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_1124c5fbf8a83821dffaf658034d2e59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4debd35f-e5d5-5c62-80d3-2312a6fc1a66/4debd35f-e5d5-5c62-80d3-2312a6fc1a66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2226748,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_1859e6bc9963ca7809f03dac0dad09ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4debd35f-e5d5-5c62-80d3-2312a6fc1a66/4debd35f-e5d5-5c62-80d3-2312a6fc1a66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2214676,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_99ea747b3ce2763397bb43714c47f204.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4debd35f-e5d5-5c62-80d3-2312a6fc1a66/4debd35f-e5d5-5c62-80d3-2312a6fc1a66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2208657,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_ad343c47a44a2fbfd8f99a8aec0c2f30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4debd35f-e5d5-5c62-80d3-2312a6fc1a66/4debd35f-e5d5-5c62-80d3-2312a6fc1a66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_e042ac648e1c67e3202c2c80e88868ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4debd35f-e5d5-5c62-80d3-2312a6fc1a66/4debd35f-e5d5-5c62-80d3-2312a6fc1a66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2160199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_421178b673e3003cd49ea096955c63e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4debd35f-e5d5-5c62-80d3-2312a6fc1a66/4debd35f-e5d5-5c62-80d3-2312a6fc1a66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2130404,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_87c8b8db22b27fd6ad37353ce2e6d1b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4debd35f-e5d5-5c62-80d3-2312a6fc1a66/4debd35f-e5d5-5c62-80d3-2312a6fc1a66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2558987,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/03/bb03a665b3054b2dcaef5ea76043d172/pa/DC17534_fb805474729dacaa1f55e704507cb00f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-27 11:31:25 [auto1.be] INFO: Saving data for DC17534: {'created_time': 1774611085.773547, 'last_price_update_time': 1774611085.773557, 'auction_closing_time': 1774714041.0}
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DC17534') HTTP/1.1" 204 0
2026-03-27 11:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with identifier: KA88762
2026-03-27 11:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with identifier: KA88762
2026-03-27 11:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with identifier: KA88762 to the API
2026-03-27 11:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_75f8085d6ce43f7af1384751b78bf0c4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:55:13Z',
 'fuel_type': 'diesel',
 'id': '12046f2e-38e9-5ef9-b288-dac9c52a5f5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA88762',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 58126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 34,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_9787d457e2b3728d06d66fa9834fd354.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_af16a0227c625e194f8b677683bcc7d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_6e85c2091cbab92c3e1afe6c2f494b81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_009f1939bb180d76d3bfe36dc405eb98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_d106e812f1c2168a0d076a8328ded94a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_b3a6e42ba544e3e4ed1697ef14e5f405.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_94fc214aa21f364d573087815592ac35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_0f2b3dc54bebfa674bc0e46e11fba3e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_c567a9f894f2dca73dd1e704c46f724a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12046f2e-38e9-5ef9-b288-dac9c52a5f5c/12046f2e-38e9-5ef9-b288-dac9c52a5f5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/10/1c101cf9b0badb5b3a0b8a42ac10e442/pa/KA88762_75f8085d6ce43f7af1384751b78bf0c4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club XL',
 'transmission': 'manual',
 'trim': 'Club XL',
 'year': 2023}
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-27 11:31:26 [auto1.be] INFO: Saving data for KA88762: {'created_time': 1774611086.160765, 'last_price_update_time': 1774611086.160776, 'auction_closing_time': 1774716913.0}
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KA88762') HTTP/1.1" 204 0
2026-03-27 11:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_987c10dd7cd87d1db03a8ba02580bbd8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_5b49771bafb6c88ead02e07116f7d982.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_4b7f053037250bad7bd740ed7fa4de78.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:26 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-27 11:31:26 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-27 11:31:26 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-27 11:31:26 [auto1.be] INFO: Scrape type for ZR23499: 2
2026-03-27 11:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with identifier: ZR23499
2026-03-27 11:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with scrape type 2
2026-03-27 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with scrape type 2
2026-03-27 11:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891, identifier: ZR23499
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_8e89aa988ae8d20e2eb83ae79d88b7f9.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_8e89aa988ae8d20e2eb83ae79d88b7f9.jpg not downloaded yet
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_b10514eabdecccf9cb248d811f333e36.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_b10514eabdecccf9cb248d811f333e36.jpg not downloaded yet
2026-03-27 11:31:26 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-27 11:31:26 [auto1.be] INFO: Found listing with ID: CB60498
2026-03-27 11:31:26 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-27 11:31:26 [auto1.be] INFO: Scrape type for NP23299: 0
2026-03-27 11:31:26 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-27 11:31:26 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-27 11:31:26 [auto1.be] INFO: Found listing with ID: YU75052
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU75052%27 HTTP/1.1" 200 None
2026-03-27 11:31:26 [auto1.be] INFO: Scrape type for YU75052: 0
2026-03-27 11:31:26 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-27 11:31:26 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-27 11:31:26 [auto1.be] INFO: Scrape type for KU11213: 2
2026-03-27 11:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with identifier: KU11213
2026-03-27 11:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with scrape type 2
2026-03-27 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with scrape type 2
2026-03-27 11:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7be753c5-0a2c-56d4-8600-92b70c76dbe3, identifier: KU11213
2026-03-27 11:31:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with identifier: ZR23499
2026-03-27 11:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with identifier: ZR23499
2026-03-27 11:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with identifier: ZR23499 to the API
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:18:22Z',
 'fuel_type': 'diesel',
 'id': '071b5eaa-f305-5ec8-a4d5-e838f8b5b891',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR23499',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 179022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-15',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-27 11:31:26 [auto1.be] INFO: Saving data for ZR23499: {'auction_closing_time': 1774714702.0, 'created_time': 1773520266.075254, 'last_price_update_time': 1774611086.793294}
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR23499') HTTP/1.1" 204 0
2026-03-27 11:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with identifier: KU11213
2026-03-27 11:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with identifier: KU11213
2026-03-27 11:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with identifier: KU11213 to the API
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:07:26Z',
 'fuel_type': 'diesel',
 'id': '7be753c5-0a2c-56d4-8600-92b70c76dbe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU11213',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 227835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-16',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2014}
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-27 11:31:27 [auto1.be] INFO: Saving data for KU11213: {'auction_closing_time': 1774714046.0, 'created_time': 1773693323.699756, 'last_price_update_time': 1774611087.235224}
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU11213') HTTP/1.1" 204 0
2026-03-27 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_9b8da8516a8275d7557f0a2697cdcd68.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_3e17bd4c2e0fde5b1ca766822f85677c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:27 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-27 11:31:27 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-27 11:31:27 [auto1.be] INFO: Scrape type for CG39340: 1
2026-03-27 11:31:27 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-27 11:31:27 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-27 11:31:27 [auto1.be] INFO: Scrape type for BP14655: 2
2026-03-27 11:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with identifier: BP14655
2026-03-27 11:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with scrape type 2
2026-03-27 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with scrape type 2
2026-03-27 11:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9, identifier: BP14655
2026-03-27 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH99432> (referer: https://www.auto1.com/v1/car-details-view/JH99432/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC36479/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with identifier: BP14655
2026-03-27 11:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with identifier: BP14655
2026-03-27 11:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with identifier: BP14655 to the API
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-28T16:48:05Z',
 'fuel_type': 'petrol',
 'id': '2111ab50-e1c7-5a65-9c0e-62a3443fc0e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP14655',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 82255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-28',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Mild-Hybrid GLE',
 'transmission': 'manual',
 'trim': 'GLE',
 'year': 2020}
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-27 11:31:27 [auto1.be] INFO: Saving data for BP14655: {'auction_closing_time': 1774716485.0, 'created_time': 1773866608.10521, 'last_price_update_time': 1774611087.69563}
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BP14655') HTTP/1.1" 204 0
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f2f5f090>
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_71c6bd74920b610a9b47eb3839c9ad22.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_71c6bd74920b610a9b47eb3839c9ad22.jpg saved to cache
2026-03-27 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba
2026-03-27 11:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with identifier: MS23670
2026-03-27 11:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with scrape type 1
2026-03-27 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fa3%252F30a307f37e4ac500013d18a70601844b%252Fpa%252FMS23670_695f390e4694ce5d0a078577cba82464.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_695f390e4694ce5d0a078577cba82464.jpg not downloaded yet
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a5e210>
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_987c10dd7cd87d1db03a8ba02580bbd8.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_987c10dd7cd87d1db03a8ba02580bbd8.jpg saved to cache
2026-03-27 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b6b890>
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_5b49771bafb6c88ead02e07116f7d982.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_5b49771bafb6c88ead02e07116f7d982.jpg saved to cache
2026-03-27 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a43692e3-7ce1-5b7d-86ec-bd984af3288e
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e0fdd0>
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_4b7f053037250bad7bd740ed7fa4de78.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_4b7f053037250bad7bd740ed7fa4de78.jpg saved to cache
2026-03-27 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a43692e3-7ce1-5b7d-86ec-bd984af3288e
2026-03-27 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_06bf9e7cac5b60dd38a7e7b40b4337e9.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_3beacd9493291be70f8b8c609b824c6e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:28 [auto1.be] INFO: Found listing with ID: FJ69250
2026-03-27 11:31:28 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-27 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-27 11:31:28 [auto1.be] INFO: Scrape type for RU19747: 2
2026-03-27 11:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with identifier: RU19747
2026-03-27 11:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with scrape type 2
2026-03-27 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with scrape type 2
2026-03-27 11:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65, identifier: RU19747
2026-03-27 11:31:28 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-27 11:31:28 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-27 11:31:28 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-27 11:31:28 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-27 11:31:28 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-27 11:31:28 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-27 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-27 11:31:28 [auto1.be] INFO: Scrape type for FG88533: 2
2026-03-27 11:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f1f9139-c0d1-5232-a696-a508ce90d715 with identifier: FG88533
2026-03-27 11:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f1f9139-c0d1-5232-a696-a508ce90d715 with scrape type 2
2026-03-27 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f1f9139-c0d1-5232-a696-a508ce90d715 with scrape type 2
2026-03-27 11:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f1f9139-c0d1-5232-a696-a508ce90d715, identifier: FG88533
2026-03-27 11:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV28567> (referer: https://www.auto1.com/v1/car-details-view/AV28567/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP07116> (referer: https://www.auto1.com/v1/car-details-view/LP07116/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_53e50a10b2acd0c51eab48e2cf3073ff.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with identifier: RU19747
2026-03-27 11:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with identifier: RU19747
2026-03-27 11:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with identifier: RU19747 to the API
2026-03-27 11:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:30:04Z',
 'fuel_type': 'diesel',
 'id': '46ddd1a9-681c-5ace-8db4-b6c85f38cc65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU19747',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 169117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-17',
 'seller_name': None,
 'title': 'Jaguar XE 20d E-Performance Portfolio',
 'transmission': 'automatic',
 'trim': 'E-Performance Portfolio',
 'year': 2016}
2026-03-27 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-27 11:31:28 [auto1.be] INFO: Saving data for RU19747: {'auction_closing_time': 1774715404.0, 'created_time': 1773747500.759796, 'last_price_update_time': 1774611088.65768}
2026-03-27 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RU19747') HTTP/1.1" 204 0
2026-03-27 11:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f1f9139-c0d1-5232-a696-a508ce90d715 with identifier: FG88533
2026-03-27 11:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f1f9139-c0d1-5232-a696-a508ce90d715 with identifier: FG88533
2026-03-27 11:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f1f9139-c0d1-5232-a696-a508ce90d715 with identifier: FG88533 to the API
2026-03-27 11:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:25:26Z',
 'fuel_type': 'diesel',
 'id': '8f1f9139-c0d1-5232-a696-a508ce90d715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG88533',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60 Cross Country',
 'odometer': 184985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-06',
 'seller_name': None,
 'title': 'Volvo V60 Cross Country 2.0 D3 Pro',
 'transmission': 'automatic',
 'trim': 'Pro',
 'year': 2017}
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-27 11:31:29 [auto1.be] INFO: Saving data for FG88533: {'auction_closing_time': 1774715126.0, 'created_time': 1773135910.865129, 'last_price_update_time': 1774611089.077679}
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FG88533') HTTP/1.1" 204 0
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fa3%252F30a307f37e4ac500013d18a70601844b%252Fpa%252FMS23670_97a324099d9a5641c3ae24a1576d3789.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_97a324099d9a5641c3ae24a1576d3789.jpg not downloaded yet
2026-03-27 11:31:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b72690>
2026-03-27 11:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb0%252Fb1b052147d29b638e86bfcdb685f4a37%252Fpa%252FSA18446_9b8da8516a8275d7557f0a2697cdcd68.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_9b8da8516a8275d7557f0a2697cdcd68.jpg saved to cache
2026-03-27 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054
2026-03-27 11:31:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73d1b95e-fdf0-5668-8718-eb44fa9fe054, skipping ID generation
2026-03-27 11:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054 with scrape type 1
2026-03-27 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73d1b95e-fdf0-5668-8718-eb44fa9fe054 sending to next pipeline
2026-03-27 11:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73d1b95e-fdf0-5668-8718-eb44fa9fe054, identifier: SA18446
2026-03-27 11:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d49ad0>
2026-03-27 11:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_3e17bd4c2e0fde5b1ca766822f85677c.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_3e17bd4c2e0fde5b1ca766822f85677c.jpg saved to cache
2026-03-27 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba
2026-03-27 11:31:29 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-27 11:31:29 [auto1.be] INFO: Scrape type for ZR56949: 2
2026-03-27 11:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with identifier: ZR56949
2026-03-27 11:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with scrape type 2
2026-03-27 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with scrape type 2
2026-03-27 11:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430, identifier: ZR56949
2026-03-27 11:31:29 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-27 11:31:29 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-27 11:31:29 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-27 11:31:29 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-27 11:31:29 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-27 11:31:29 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-27 11:31:29 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-27 11:31:29 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-27 11:31:29 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-27 11:31:29 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-27 11:31:29 [auto1.be] INFO: Scrape type for XE73160: 2
2026-03-27 11:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with identifier: XE73160
2026-03-27 11:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with scrape type 2
2026-03-27 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with scrape type 2
2026-03-27 11:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc, identifier: XE73160
2026-03-27 11:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE65833> (referer: https://www.auto1.com/v1/car-details-view/CE65833/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP78411> (referer: https://www.auto1.com/v1/car-details-view/VP78411/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73d1b95e-fdf0-5668-8718-eb44fa9fe054 with identifier: SA18446
2026-03-27 11:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73d1b95e-fdf0-5668-8718-eb44fa9fe054 with identifier: SA18446
2026-03-27 11:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73d1b95e-fdf0-5668-8718-eb44fa9fe054 with identifier: SA18446 to the API
2026-03-27 11:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_9b8da8516a8275d7557f0a2697cdcd68.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 88,
 'expiration_date': '2026-03-28T16:54:57Z',
 'fuel_type': 'diesel',
 'id': '73d1b95e-fdf0-5668-8718-eb44fa9fe054',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA18446',
 'listing': 'auction',
 'location': 'BE, Wauthier-Braine',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 97709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3677385,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_d7e61a5c710a42bff7a0a3088a564f2c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3777965,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_b20db1e15482e1d754092cb5c8cb17e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3337978,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_64d2bd015a0d4bab33d72257db8156ae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_a028b00a3e3087a03500a60d064e0139.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_91e56fbbd85091cc83bf9d341a3fcab1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_bfff3cef2e60a05d88bde1192edb564a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_8e4cd8a16cca9e813c6150bbffe8123a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3626173,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_9b8da8516a8275d7557f0a2697cdcd68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_86bf63fa08d7a7c38e656a9607a28d8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d1b95e-fdf0-5668-8718-eb44fa9fe054/73d1b95e-fdf0-5668-8718-eb44fa9fe054_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b0/b1b052147d29b638e86bfcdb685f4a37/pa/SA18446_da44f95ba831edf62317ab90294156ed.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA18446%27 HTTP/1.1" 200 None
2026-03-27 11:31:30 [auto1.be] INFO: Saving data for SA18446: {'created_time': 1774611090.136024, 'last_price_update_time': 1774611090.136037, 'auction_closing_time': 1774716897.0}
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SA18446') HTTP/1.1" 204 0
2026-03-27 11:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eb3dd54-fd54-5817-846f-028d5cf23468 with identifier: JH99432
2026-03-27 11:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eb3dd54-fd54-5817-846f-028d5cf23468 with scrape type 1
2026-03-27 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6eb3dd54-fd54-5817-846f-028d5cf23468
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F6f%252F896fe3e626fe3c44e5d3b164e3f39964%252Fpa%252FJH99432_71f99ebbd1c82199ca14eabab6da57c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_71f99ebbd1c82199ca14eabab6da57c4.jpg already downloaded
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F6f%252F896fe3e626fe3c44e5d3b164e3f39964%252Fpa%252FJH99432_b559f8a1ba959c19c71dbdd6745711c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_b559f8a1ba959c19c71dbdd6745711c5.jpg already downloaded
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F6f%252F896fe3e626fe3c44e5d3b164e3f39964%252Fpa%252FJH99432_7c1cf07b5187e808bc199d40f9f734b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_7c1cf07b5187e808bc199d40f9f734b1.jpg already downloaded
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F6f%252F896fe3e626fe3c44e5d3b164e3f39964%252Fpa%252FJH99432_5d7b466889d25296a442e4539514ad1b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_5d7b466889d25296a442e4539514ad1b.jpg already downloaded
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F6f%252F896fe3e626fe3c44e5d3b164e3f39964%252Fpa%252FJH99432_b16e7f5cd6c97d508a8456f8cc6f35d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_b16e7f5cd6c97d508a8456f8cc6f35d5.jpg already downloaded
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F6f%252F896fe3e626fe3c44e5d3b164e3f39964%252Fpa%252FJH99432_5319c2e413e98a0fc1363f135ee7afd4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_5319c2e413e98a0fc1363f135ee7afd4.jpg already downloaded
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F6f%252F896fe3e626fe3c44e5d3b164e3f39964%252Fpa%252FJH99432_f487b3fa73944c3e26a97380b82594dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_f487b3fa73944c3e26a97380b82594dd.jpg already downloaded
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F6f%252F896fe3e626fe3c44e5d3b164e3f39964%252Fpa%252FJH99432_5845aab48002593580461ceb81edda5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_5845aab48002593580461ceb81edda5a.jpg already downloaded
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F6f%252F896fe3e626fe3c44e5d3b164e3f39964%252Fpa%252FJH99432_482b608234ae78d90ec4f22fe69d3b6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_482b608234ae78d90ec4f22fe69d3b6a.jpg already downloaded
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F6f%252F896fe3e626fe3c44e5d3b164e3f39964%252Fpa%252FJH99432_7fdca2def1a8f50bf71d5614e7cbeab1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_7fdca2def1a8f50bf71d5614e7cbeab1.jpg already downloaded
2026-03-27 11:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6eb3dd54-fd54-5817-846f-028d5cf23468, identifier: JH99432
2026-03-27 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_b10514eabdecccf9cb248d811f333e36.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_8e89aa988ae8d20e2eb83ae79d88b7f9.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with identifier: ZR56949
2026-03-27 11:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with identifier: ZR56949
2026-03-27 11:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with identifier: ZR56949 to the API
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:18:05Z',
 'fuel_type': 'diesel',
 'id': '0e3d8b2f-0b45-5bac-8370-2e8accb5a430',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR56949',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 157227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2021}
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-27 11:31:30 [auto1.be] INFO: Saving data for ZR56949: {'auction_closing_time': 1774714685.0, 'created_time': 1773132593.343894, 'last_price_update_time': 1774611090.973979}
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR56949') HTTP/1.1" 204 0
2026-03-27 11:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with identifier: XE73160
2026-03-27 11:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with identifier: XE73160
2026-03-27 11:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with identifier: XE73160 to the API
2026-03-27 11:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:39:19Z',
 'fuel_type': 'diesel',
 'id': '6eefabaa-9783-5e72-8cc3-9dc4062c79fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE73160',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 184151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-22',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2011}
2026-03-27 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-27 11:31:31 [auto1.be] INFO: Saving data for XE73160: {'auction_closing_time': 1774715959.0, 'created_time': 1773693900.046291, 'last_price_update_time': 1774611091.790171}
2026-03-27 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XE73160') HTTP/1.1" 204 0
2026-03-27 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fa3%252F30a307f37e4ac500013d18a70601844b%252Fpa%252FMS23670_213e2bd5540db541003894f9d88ee58c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_213e2bd5540db541003894f9d88ee58c.jpg not downloaded yet
2026-03-27 11:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6eb3dd54-fd54-5817-846f-028d5cf23468 with identifier: JH99432
2026-03-27 11:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:31:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-27 11:31:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6eb3dd54-fd54-5817-846f-028d5cf23468 with identifier: JH99432
2026-03-27 11:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6eb3dd54-fd54-5817-846f-028d5cf23468 with identifier: JH99432 to the API
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JH99432>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '4.8L',
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:05:02Z',
 'fuel_type': 'petrol',
 'id': '6eb3dd54-fd54-5817-846f-028d5cf23468',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH99432',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '6er',
 'odometer': 112523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_71f99ebbd1c82199ca14eabab6da57c4.jpg',
                'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_b559f8a1ba959c19c71dbdd6745711c5.jpg',
                'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_7c1cf07b5187e808bc199d40f9f734b1.jpg',
                'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_5d7b466889d25296a442e4539514ad1b.jpg',
                'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_b16e7f5cd6c97d508a8456f8cc6f35d5.jpg',
                'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_5319c2e413e98a0fc1363f135ee7afd4.jpg',
                'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_f487b3fa73944c3e26a97380b82594dd.jpg',
                'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_5845aab48002593580461ceb81edda5a.jpg',
                'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_482b608234ae78d90ec4f22fe69d3b6a.jpg',
                'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_7fdca2def1a8f50bf71d5614e7cbeab1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb3dd54-fd54-5817-846f-028d5cf23468/6eb3dd54-fd54-5817-846f-028d5cf23468_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_71f99ebbd1c82199ca14eabab6da57c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb3dd54-fd54-5817-846f-028d5cf23468/6eb3dd54-fd54-5817-846f-028d5cf23468_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_b559f8a1ba959c19c71dbdd6745711c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb3dd54-fd54-5817-846f-028d5cf23468/6eb3dd54-fd54-5817-846f-028d5cf23468_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_7c1cf07b5187e808bc199d40f9f734b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb3dd54-fd54-5817-846f-028d5cf23468/6eb3dd54-fd54-5817-846f-028d5cf23468_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_5d7b466889d25296a442e4539514ad1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb3dd54-fd54-5817-846f-028d5cf23468/6eb3dd54-fd54-5817-846f-028d5cf23468_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_b16e7f5cd6c97d508a8456f8cc6f35d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb3dd54-fd54-5817-846f-028d5cf23468/6eb3dd54-fd54-5817-846f-028d5cf23468_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_5319c2e413e98a0fc1363f135ee7afd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb3dd54-fd54-5817-846f-028d5cf23468/6eb3dd54-fd54-5817-846f-028d5cf23468_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_f487b3fa73944c3e26a97380b82594dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb3dd54-fd54-5817-846f-028d5cf23468/6eb3dd54-fd54-5817-846f-028d5cf23468_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_5845aab48002593580461ceb81edda5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb3dd54-fd54-5817-846f-028d5cf23468/6eb3dd54-fd54-5817-846f-028d5cf23468_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_482b608234ae78d90ec4f22fe69d3b6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb3dd54-fd54-5817-846f-028d5cf23468/6eb3dd54-fd54-5817-846f-028d5cf23468_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/6f/896fe3e626fe3c44e5d3b164e3f39964/pa/JH99432_7fdca2def1a8f50bf71d5614e7cbeab1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-09-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 6er 650 CI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH99432%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [auto1.be] INFO: Saving data for JH99432: {'created_time': 1774611092.275216, 'last_price_update_time': 1774611092.275226, 'auction_closing_time': 1774713902.0}
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JH99432') HTTP/1.1" 204 0
2026-03-27 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_fa3c840349c5e8b89224e5a07f2752d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_dafbd83891ef8c7351a66b5adeebbde0.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:32 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [auto1.be] INFO: Scrape type for RP30975: 2
2026-03-27 11:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5618d539-8186-5418-95ae-d9583b7e2f7a with identifier: RP30975
2026-03-27 11:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5618d539-8186-5418-95ae-d9583b7e2f7a with scrape type 2
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5618d539-8186-5418-95ae-d9583b7e2f7a with scrape type 2
2026-03-27 11:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5618d539-8186-5418-95ae-d9583b7e2f7a, identifier: RP30975
2026-03-27 11:31:32 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [auto1.be] INFO: Scrape type for PC96861: 0
2026-03-27 11:31:32 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [auto1.be] INFO: Scrape type for AE23838: 2
2026-03-27 11:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with identifier: AE23838
2026-03-27 11:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with scrape type 2
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with scrape type 2
2026-03-27 11:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7, identifier: AE23838
2026-03-27 11:31:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f2c741d0>
2026-03-27 11:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_06bf9e7cac5b60dd38a7e7b40b4337e9.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_06bf9e7cac5b60dd38a7e7b40b4337e9.jpg saved to cache
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba
2026-03-27 11:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0aaea90>
2026-03-27 11:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_3beacd9493291be70f8b8c609b824c6e.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_3beacd9493291be70f8b8c609b824c6e.jpg saved to cache
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a43692e3-7ce1-5b7d-86ec-bd984af3288e
2026-03-27 11:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with identifier: AV28567
2026-03-27 11:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with scrape type 1
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f4c3fea-c5da-5a46-a72e-587bf909bd4f
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F81%252Fba81655294f5d670a2cb8b7dd5b754bc%252Fpa%252FAV28567_977e542f3d74d8a1c7c68b36872a8734.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_977e542f3d74d8a1c7c68b36872a8734.jpg already downloaded
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F81%252Fba81655294f5d670a2cb8b7dd5b754bc%252Fpa%252FAV28567_af298d977a9bafc648285d905e6e1047.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_af298d977a9bafc648285d905e6e1047.jpg already downloaded
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F81%252Fba81655294f5d670a2cb8b7dd5b754bc%252Fpa%252FAV28567_688a00a5d76b2f1eafbb0189b66bd908.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_688a00a5d76b2f1eafbb0189b66bd908.jpg already downloaded
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F81%252Fba81655294f5d670a2cb8b7dd5b754bc%252Fpa%252FAV28567_c7e9f044837779c79a4642f1b227fae4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_c7e9f044837779c79a4642f1b227fae4.jpg already downloaded
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F81%252Fba81655294f5d670a2cb8b7dd5b754bc%252Fpa%252FAV28567_71ba31ce2b6dd8f0e58e2561dc4b23e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_71ba31ce2b6dd8f0e58e2561dc4b23e8.jpg already downloaded
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F81%252Fba81655294f5d670a2cb8b7dd5b754bc%252Fpa%252FAV28567_b90ef4231bde2d5f5a75a9d834bdb1b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_b90ef4231bde2d5f5a75a9d834bdb1b8.jpg already downloaded
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F81%252Fba81655294f5d670a2cb8b7dd5b754bc%252Fpa%252FAV28567_79715e4431ec0563fbe6fa69d957ff2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_79715e4431ec0563fbe6fa69d957ff2a.jpg already downloaded
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F81%252Fba81655294f5d670a2cb8b7dd5b754bc%252Fpa%252FAV28567_8c86ba19170c3c1a40b16f31bd074a4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_8c86ba19170c3c1a40b16f31bd074a4b.jpg already downloaded
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F81%252Fba81655294f5d670a2cb8b7dd5b754bc%252Fpa%252FAV28567_40704b05893dec4c457e456610ac9d47.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_40704b05893dec4c457e456610ac9d47.jpg already downloaded
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F81%252Fba81655294f5d670a2cb8b7dd5b754bc%252Fpa%252FAV28567_4587c2976a12a7103240d28597ad42b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_4587c2976a12a7103240d28597ad42b8.jpg already downloaded
2026-03-27 11:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f, identifier: AV28567
2026-03-27 11:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with identifier: LP07116
2026-03-27 11:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with scrape type 1
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb9%252Fe1b93163c3985920274f0ea74b7f92a1%252Fpa%252FLP07116_fe6cbc6d01f3022adb51381859970a59.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_fe6cbc6d01f3022adb51381859970a59.jpg not downloaded yet
2026-03-27 11:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e8d8d0>
2026-03-27 11:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_53e50a10b2acd0c51eab48e2cf3073ff.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_53e50a10b2acd0c51eab48e2cf3073ff.jpg saved to cache
2026-03-27 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba
2026-03-27 11:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5618d539-8186-5418-95ae-d9583b7e2f7a with identifier: RP30975
2026-03-27 11:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5618d539-8186-5418-95ae-d9583b7e2f7a with identifier: RP30975
2026-03-27 11:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5618d539-8186-5418-95ae-d9583b7e2f7a with identifier: RP30975 to the API
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:58:55Z',
 'fuel_type': 'diesel',
 'id': '5618d539-8186-5418-95ae-d9583b7e2f7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP30975',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 180172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-08',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2016}
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-27 11:31:33 [auto1.be] INFO: Saving data for RP30975: {'auction_closing_time': 1774717135.0, 'created_time': 1773301773.417088, 'last_price_update_time': 1774611093.275391}
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RP30975') HTTP/1.1" 204 0
2026-03-27 11:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with identifier: AE23838
2026-03-27 11:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with identifier: AE23838
2026-03-27 11:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with identifier: AE23838 to the API
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:18:58Z',
 'fuel_type': 'petrol',
 'id': 'fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE23838',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 168072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-14',
 'seller_name': None,
 'title': 'Mazda 2 1.5 Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2019}
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-27 11:31:33 [auto1.be] INFO: Saving data for AE23838: {'auction_closing_time': 1774714738.0, 'created_time': 1773233800.359867, 'last_price_update_time': 1774611093.607793}
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AE23838') HTTP/1.1" 204 0
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fa3%252F30a307f37e4ac500013d18a70601844b%252Fpa%252FMS23670_d4889e04fb2af5330a748c20280fd1c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_d4889e04fb2af5330a748c20280fd1c4.jpg not downloaded yet
2026-03-27 11:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with identifier: AV28567
2026-03-27 11:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with identifier: AV28567
2026-03-27 11:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with identifier: AV28567 to the API
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AV28567>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:32:59Z',
 'fuel_type': 'petrol',
 'id': '2f4c3fea-c5da-5a46-a72e-587bf909bd4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV28567',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 191712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_977e542f3d74d8a1c7c68b36872a8734.jpg',
                'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_af298d977a9bafc648285d905e6e1047.jpg',
                'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_688a00a5d76b2f1eafbb0189b66bd908.jpg',
                'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_c7e9f044837779c79a4642f1b227fae4.jpg',
                'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_71ba31ce2b6dd8f0e58e2561dc4b23e8.jpg',
                'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_b90ef4231bde2d5f5a75a9d834bdb1b8.jpg',
                'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_79715e4431ec0563fbe6fa69d957ff2a.jpg',
                'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_8c86ba19170c3c1a40b16f31bd074a4b.jpg',
                'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_40704b05893dec4c457e456610ac9d47.jpg',
                'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_4587c2976a12a7103240d28597ad42b8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f4c3fea-c5da-5a46-a72e-587bf909bd4f/2f4c3fea-c5da-5a46-a72e-587bf909bd4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_977e542f3d74d8a1c7c68b36872a8734.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f4c3fea-c5da-5a46-a72e-587bf909bd4f/2f4c3fea-c5da-5a46-a72e-587bf909bd4f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_af298d977a9bafc648285d905e6e1047.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f4c3fea-c5da-5a46-a72e-587bf909bd4f/2f4c3fea-c5da-5a46-a72e-587bf909bd4f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_688a00a5d76b2f1eafbb0189b66bd908.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f4c3fea-c5da-5a46-a72e-587bf909bd4f/2f4c3fea-c5da-5a46-a72e-587bf909bd4f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_c7e9f044837779c79a4642f1b227fae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f4c3fea-c5da-5a46-a72e-587bf909bd4f/2f4c3fea-c5da-5a46-a72e-587bf909bd4f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_71ba31ce2b6dd8f0e58e2561dc4b23e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f4c3fea-c5da-5a46-a72e-587bf909bd4f/2f4c3fea-c5da-5a46-a72e-587bf909bd4f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_b90ef4231bde2d5f5a75a9d834bdb1b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f4c3fea-c5da-5a46-a72e-587bf909bd4f/2f4c3fea-c5da-5a46-a72e-587bf909bd4f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_79715e4431ec0563fbe6fa69d957ff2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f4c3fea-c5da-5a46-a72e-587bf909bd4f/2f4c3fea-c5da-5a46-a72e-587bf909bd4f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_8c86ba19170c3c1a40b16f31bd074a4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f4c3fea-c5da-5a46-a72e-587bf909bd4f/2f4c3fea-c5da-5a46-a72e-587bf909bd4f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_40704b05893dec4c457e456610ac9d47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f4c3fea-c5da-5a46-a72e-587bf909bd4f/2f4c3fea-c5da-5a46-a72e-587bf909bd4f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/81/ba81655294f5d670a2cb8b7dd5b754bc/pa/AV28567_4587c2976a12a7103240d28597ad42b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-27 11:31:33 [auto1.be] INFO: Saving data for AV28567: {'created_time': 1774611093.966959, 'last_price_update_time': 1774611093.96697, 'auction_closing_time': 1774715579.0}
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AV28567') HTTP/1.1" 204 0
2026-03-27 11:31:33 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [auto1.be] INFO: Scrape type for WB95668: 2
2026-03-27 11:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 908eec7f-7516-5981-917f-04dc3b597b5e with identifier: WB95668
2026-03-27 11:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 908eec7f-7516-5981-917f-04dc3b597b5e with scrape type 2
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 908eec7f-7516-5981-917f-04dc3b597b5e with scrape type 2
2026-03-27 11:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 908eec7f-7516-5981-917f-04dc3b597b5e, identifier: WB95668
2026-03-27 11:31:34 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [auto1.be] INFO: Scrape type for HP14917: 0
2026-03-27 11:31:34 [auto1.be] INFO: Found listing with ID: ZD51863
2026-03-27 11:31:34 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [auto1.be] INFO: Scrape type for HB19534: 2
2026-03-27 11:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb7c6609-2f10-5d13-9ef1-ff7bac632954 with identifier: HB19534
2026-03-27 11:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb7c6609-2f10-5d13-9ef1-ff7bac632954 with scrape type 2
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb7c6609-2f10-5d13-9ef1-ff7bac632954 with scrape type 2
2026-03-27 11:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb7c6609-2f10-5d13-9ef1-ff7bac632954, identifier: HB19534
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb9%252Fe1b93163c3985920274f0ea74b7f92a1%252Fpa%252FLP07116_6f8a3b664246a54547738bd54db23d5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_6f8a3b664246a54547738bd54db23d5f.jpg not downloaded yet
2026-03-27 11:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with identifier: CE65833
2026-03-27 11:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with scrape type 1
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F73%252F8273ec11c2ed353b7e21122bdcda95fb%252Fpa%252FCE65833_6485138dbfed89c89ebc7028e4f99727.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_6485138dbfed89c89ebc7028e4f99727.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F73%252F8273ec11c2ed353b7e21122bdcda95fb%252Fpa%252FCE65833_e7d6c60ad1ab0432ac0ea967d0df0e14.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_e7d6c60ad1ab0432ac0ea967d0df0e14.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F73%252F8273ec11c2ed353b7e21122bdcda95fb%252Fpa%252FCE65833_114b5a4c2b8e2edf906b8630dabaf202.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_114b5a4c2b8e2edf906b8630dabaf202.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F73%252F8273ec11c2ed353b7e21122bdcda95fb%252Fpa%252FCE65833_31fa7a4d0a0cfa775ed3d29a7e8bbe96.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_31fa7a4d0a0cfa775ed3d29a7e8bbe96.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F73%252F8273ec11c2ed353b7e21122bdcda95fb%252Fpa%252FCE65833_3d24d0314fe4de0fe758e65e8b9edcca.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_3d24d0314fe4de0fe758e65e8b9edcca.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F73%252F8273ec11c2ed353b7e21122bdcda95fb%252Fpa%252FCE65833_895a4f4f42ed0e88d47480c84ecb0e98.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_895a4f4f42ed0e88d47480c84ecb0e98.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F73%252F8273ec11c2ed353b7e21122bdcda95fb%252Fpa%252FCE65833_a0ff3469eb626b9f06e8ff59a33aa095.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_a0ff3469eb626b9f06e8ff59a33aa095.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F73%252F8273ec11c2ed353b7e21122bdcda95fb%252Fpa%252FCE65833_34c44c71aca82879fd1bc4277187dd20.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_34c44c71aca82879fd1bc4277187dd20.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F73%252F8273ec11c2ed353b7e21122bdcda95fb%252Fpa%252FCE65833_7390e2db56d75da26817b7a02177e3f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_7390e2db56d75da26817b7a02177e3f5.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F73%252F8273ec11c2ed353b7e21122bdcda95fb%252Fpa%252FCE65833_dc22b8ae670a81a2d86bd977c81a6686.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_dc22b8ae670a81a2d86bd977c81a6686.jpg already downloaded
2026-03-27 11:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f, identifier: CE65833
2026-03-27 11:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9863b681-833e-52f6-b759-532c5c256fc7 with identifier: VP78411
2026-03-27 11:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9863b681-833e-52f6-b759-532c5c256fc7 with scrape type 1
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9863b681-833e-52f6-b759-532c5c256fc7
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F86%252F0486cde395b3f995b9d58d1b8a288b9a%252Fpa%252FVP78411_2ef147497f3335e7caef613769810432.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_2ef147497f3335e7caef613769810432.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F86%252F0486cde395b3f995b9d58d1b8a288b9a%252Fpa%252FVP78411_809ae9de621cdd84ef6cbbbe0c713a2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_809ae9de621cdd84ef6cbbbe0c713a2f.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F86%252F0486cde395b3f995b9d58d1b8a288b9a%252Fpa%252FVP78411_02122f02337902f90301da6ee799d1a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_02122f02337902f90301da6ee799d1a6.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F86%252F0486cde395b3f995b9d58d1b8a288b9a%252Fpa%252FVP78411_338bc685071b5b4706641ab9b0b89570.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_338bc685071b5b4706641ab9b0b89570.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F86%252F0486cde395b3f995b9d58d1b8a288b9a%252Fpa%252FVP78411_8cee8a7d775b6decf24318e37bcb0cf4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_8cee8a7d775b6decf24318e37bcb0cf4.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F86%252F0486cde395b3f995b9d58d1b8a288b9a%252Fpa%252FVP78411_2ede733567c4f58bfcb4030e34c48fe4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_2ede733567c4f58bfcb4030e34c48fe4.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F86%252F0486cde395b3f995b9d58d1b8a288b9a%252Fpa%252FVP78411_3bf300c558032650d3e5dac989e43053.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_3bf300c558032650d3e5dac989e43053.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F86%252F0486cde395b3f995b9d58d1b8a288b9a%252Fpa%252FVP78411_77c03c630708610e96101fa3fdf17156.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_77c03c630708610e96101fa3fdf17156.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F86%252F0486cde395b3f995b9d58d1b8a288b9a%252Fpa%252FVP78411_64fa17956760adefddd0cf2c6692ce99.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_64fa17956760adefddd0cf2c6692ce99.jpg already downloaded
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F86%252F0486cde395b3f995b9d58d1b8a288b9a%252Fpa%252FVP78411_de34b2325c5a3bdf5854ea322b293c75.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_de34b2325c5a3bdf5854ea322b293c75.jpg already downloaded
2026-03-27 11:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9863b681-833e-52f6-b759-532c5c256fc7, identifier: VP78411
2026-03-27 11:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0af8e90>
2026-03-27 11:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_b10514eabdecccf9cb248d811f333e36.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_b10514eabdecccf9cb248d811f333e36.jpg saved to cache
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba
2026-03-27 11:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d29f90>
2026-03-27 11:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_8e89aa988ae8d20e2eb83ae79d88b7f9.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_8e89aa988ae8d20e2eb83ae79d88b7f9.jpg saved to cache
2026-03-27 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a43692e3-7ce1-5b7d-86ec-bd984af3288e
2026-03-27 11:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 908eec7f-7516-5981-917f-04dc3b597b5e with identifier: WB95668
2026-03-27 11:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 908eec7f-7516-5981-917f-04dc3b597b5e with identifier: WB95668
2026-03-27 11:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 908eec7f-7516-5981-917f-04dc3b597b5e with identifier: WB95668 to the API
2026-03-27 11:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:57Z',
 'fuel_type': 'petrol',
 'id': '908eec7f-7516-5981-917f-04dc3b597b5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB95668',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 52050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-06',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Edition 30+ 2WD',
 'transmission': 'manual',
 'trim': 'Edition 30+ 2WD',
 'year': 2022}
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-27 11:31:35 [auto1.be] INFO: Saving data for WB95668: {'auction_closing_time': 1774715577.0, 'created_time': 1773834012.266552, 'last_price_update_time': 1774611095.202348}
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WB95668') HTTP/1.1" 204 0
2026-03-27 11:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb7c6609-2f10-5d13-9ef1-ff7bac632954 with identifier: HB19534
2026-03-27 11:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb7c6609-2f10-5d13-9ef1-ff7bac632954 with identifier: HB19534
2026-03-27 11:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb7c6609-2f10-5d13-9ef1-ff7bac632954 with identifier: HB19534 to the API
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:47:25Z',
 'fuel_type': 'diesel',
 'id': 'cb7c6609-2f10-5d13-9ef1-ff7bac632954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB19534',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 161681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-26',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2017}
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-27 11:31:35 [auto1.be] INFO: Saving data for HB19534: {'auction_closing_time': 1774716445.0, 'created_time': 1773301720.088691, 'last_price_update_time': 1774611095.68777}
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HB19534') HTTP/1.1" 204 0
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fa3%252F30a307f37e4ac500013d18a70601844b%252Fpa%252FMS23670_70dada0422f1ca9be8a5edf87feaa12e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_70dada0422f1ca9be8a5edf87feaa12e.jpg not downloaded yet
2026-03-27 11:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with identifier: CE65833
2026-03-27 11:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with identifier: CE65833
2026-03-27 11:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with identifier: CE65833 to the API
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CE65833>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 121,
 'expiration_date': '2026-03-28T16:14:40Z',
 'fuel_type': 'petrol',
 'id': 'a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE65833',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 218199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_6485138dbfed89c89ebc7028e4f99727.jpg',
                'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_e7d6c60ad1ab0432ac0ea967d0df0e14.jpg',
                'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_114b5a4c2b8e2edf906b8630dabaf202.jpg',
                'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_31fa7a4d0a0cfa775ed3d29a7e8bbe96.jpg',
                'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_3d24d0314fe4de0fe758e65e8b9edcca.jpg',
                'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_895a4f4f42ed0e88d47480c84ecb0e98.jpg',
                'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_a0ff3469eb626b9f06e8ff59a33aa095.jpg',
                'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_34c44c71aca82879fd1bc4277187dd20.jpg',
                'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_7390e2db56d75da26817b7a02177e3f5.jpg',
                'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_dc22b8ae670a81a2d86bd977c81a6686.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f/a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_6485138dbfed89c89ebc7028e4f99727.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f/a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_e7d6c60ad1ab0432ac0ea967d0df0e14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f/a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_114b5a4c2b8e2edf906b8630dabaf202.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f/a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_31fa7a4d0a0cfa775ed3d29a7e8bbe96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f/a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_3d24d0314fe4de0fe758e65e8b9edcca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f/a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_895a4f4f42ed0e88d47480c84ecb0e98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f/a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_a0ff3469eb626b9f06e8ff59a33aa095.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f/a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_34c44c71aca82879fd1bc4277187dd20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f/a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_7390e2db56d75da26817b7a02177e3f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f/a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/73/8273ec11c2ed353b7e21122bdcda95fb/pa/CE65833_dc22b8ae670a81a2d86bd977c81a6686.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV Motion 4WD',
 'transmission': 'automatic',
 'trim': 'Motion 4WD',
 'year': 2015}
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-27 11:31:36 [auto1.be] INFO: Saving data for CE65833: {'created_time': 1774611096.059278, 'last_price_update_time': 1774611096.059288, 'auction_closing_time': 1774714480.0}
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE65833') HTTP/1.1" 204 0
2026-03-27 11:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9863b681-833e-52f6-b759-532c5c256fc7 with identifier: VP78411
2026-03-27 11:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9863b681-833e-52f6-b759-532c5c256fc7 with identifier: VP78411
2026-03-27 11:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9863b681-833e-52f6-b759-532c5c256fc7 with identifier: VP78411 to the API
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VP78411>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:09:32Z',
 'fuel_type': 'gas',
 'id': '9863b681-833e-52f6-b759-532c5c256fc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP78411',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 43853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_2ef147497f3335e7caef613769810432.jpg',
                'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_809ae9de621cdd84ef6cbbbe0c713a2f.jpg',
                'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_02122f02337902f90301da6ee799d1a6.jpg',
                'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_338bc685071b5b4706641ab9b0b89570.jpg',
                'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_8cee8a7d775b6decf24318e37bcb0cf4.jpg',
                'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_2ede733567c4f58bfcb4030e34c48fe4.jpg',
                'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_3bf300c558032650d3e5dac989e43053.jpg',
                'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_77c03c630708610e96101fa3fdf17156.jpg',
                'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_64fa17956760adefddd0cf2c6692ce99.jpg',
                'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_de34b2325c5a3bdf5854ea322b293c75.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9863b681-833e-52f6-b759-532c5c256fc7/9863b681-833e-52f6-b759-532c5c256fc7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_2ef147497f3335e7caef613769810432.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9863b681-833e-52f6-b759-532c5c256fc7/9863b681-833e-52f6-b759-532c5c256fc7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_809ae9de621cdd84ef6cbbbe0c713a2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9863b681-833e-52f6-b759-532c5c256fc7/9863b681-833e-52f6-b759-532c5c256fc7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_02122f02337902f90301da6ee799d1a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9863b681-833e-52f6-b759-532c5c256fc7/9863b681-833e-52f6-b759-532c5c256fc7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_338bc685071b5b4706641ab9b0b89570.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9863b681-833e-52f6-b759-532c5c256fc7/9863b681-833e-52f6-b759-532c5c256fc7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_8cee8a7d775b6decf24318e37bcb0cf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9863b681-833e-52f6-b759-532c5c256fc7/9863b681-833e-52f6-b759-532c5c256fc7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_2ede733567c4f58bfcb4030e34c48fe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9863b681-833e-52f6-b759-532c5c256fc7/9863b681-833e-52f6-b759-532c5c256fc7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_3bf300c558032650d3e5dac989e43053.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9863b681-833e-52f6-b759-532c5c256fc7/9863b681-833e-52f6-b759-532c5c256fc7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_77c03c630708610e96101fa3fdf17156.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9863b681-833e-52f6-b759-532c5c256fc7/9863b681-833e-52f6-b759-532c5c256fc7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_64fa17956760adefddd0cf2c6692ce99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9863b681-833e-52f6-b759-532c5c256fc7/9863b681-833e-52f6-b759-532c5c256fc7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/86/0486cde395b3f995b9d58d1b8a288b9a/pa/VP78411_de34b2325c5a3bdf5854ea322b293c75.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe LPG Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2021}
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-27 11:31:36 [auto1.be] INFO: Saving data for VP78411: {'created_time': 1774611096.395572, 'last_price_update_time': 1774611096.395584, 'auction_closing_time': 1774714172.0}
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP78411') HTTP/1.1" 204 0
2026-03-27 11:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b28610>
2026-03-27 11:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_fa3c840349c5e8b89224e5a07f2752d5.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_fa3c840349c5e8b89224e5a07f2752d5.jpg saved to cache
2026-03-27 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a43692e3-7ce1-5b7d-86ec-bd984af3288e
2026-03-27 11:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0afa0d0>
2026-03-27 11:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_dafbd83891ef8c7351a66b5adeebbde0.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_dafbd83891ef8c7351a66b5adeebbde0.jpg saved to cache
2026-03-27 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba
2026-03-27 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_695f390e4694ce5d0a078577cba82464.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_97adcc73c2be819d7f542151a720cd7f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:36 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-27 11:31:36 [auto1.be] INFO: Scrape type for RX75304: 2
2026-03-27 11:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fab1503-6f64-5957-9420-b7a7ebe4cffd with identifier: RX75304
2026-03-27 11:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fab1503-6f64-5957-9420-b7a7ebe4cffd with scrape type 2
2026-03-27 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fab1503-6f64-5957-9420-b7a7ebe4cffd with scrape type 2
2026-03-27 11:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7fab1503-6f64-5957-9420-b7a7ebe4cffd, identifier: RX75304
2026-03-27 11:31:36 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-27 11:31:36 [auto1.be] INFO: Scrape type for ND89972: 2
2026-03-27 11:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with identifier: ND89972
2026-03-27 11:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with scrape type 2
2026-03-27 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with scrape type 2
2026-03-27 11:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1, identifier: ND89972
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb9%252Fe1b93163c3985920274f0ea74b7f92a1%252Fpa%252FLP07116_ced690b1173e1d0686c6d95c287ba024.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_ced690b1173e1d0686c6d95c287ba024.jpg not downloaded yet
2026-03-27 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_97a324099d9a5641c3ae24a1576d3789.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7fab1503-6f64-5957-9420-b7a7ebe4cffd with identifier: RX75304
2026-03-27 11:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7fab1503-6f64-5957-9420-b7a7ebe4cffd with identifier: RX75304
2026-03-27 11:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7fab1503-6f64-5957-9420-b7a7ebe4cffd with identifier: RX75304 to the API
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:33:11Z',
 'fuel_type': 'diesel',
 'id': '7fab1503-6f64-5957-9420-b7a7ebe4cffd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX75304',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 222184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-27',
 'seller_name': None,
 'title': 'Ford S-Max 1.8 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-27 11:31:37 [auto1.be] INFO: Saving data for RX75304: {'auction_closing_time': 1774715591.0, 'created_time': 1773132646.591593, 'last_price_update_time': 1774611097.054803}
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RX75304') HTTP/1.1" 204 0
2026-03-27 11:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with identifier: ND89972
2026-03-27 11:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with identifier: ND89972
2026-03-27 11:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with identifier: ND89972 to the API
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:54:49Z',
 'fuel_type': 'petrol',
 'id': '85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND89972',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 14358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-05',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 35 AMG Shooting Brake Mild-Hybrid '
          '4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2023}
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-27 11:31:37 [auto1.be] INFO: Saving data for ND89972: {'auction_closing_time': 1774716889.0, 'created_time': 1773132509.81165, 'last_price_update_time': 1774611097.392868}
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ND89972') HTTP/1.1" 204 0
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fa3%252F30a307f37e4ac500013d18a70601844b%252Fpa%252FMS23670_a9d16000472bdf568874345431502fdb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_a9d16000472bdf568874345431502fdb.jpg not downloaded yet
2026-03-27 11:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK80434/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG39340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_213e2bd5540db541003894f9d88ee58c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:37 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-27 11:31:37 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-27 11:31:37 [auto1.be] INFO: Scrape type for HL95749: 2
2026-03-27 11:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with identifier: HL95749
2026-03-27 11:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with scrape type 2
2026-03-27 11:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with scrape type 2
2026-03-27 11:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ce52f5ce-1b5d-58ca-9610-cea76740a1b5, identifier: HL95749
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb9%252Fe1b93163c3985920274f0ea74b7f92a1%252Fpa%252FLP07116_4f447bce8f3ba4d7d9e4308b4d891d38.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_4f447bce8f3ba4d7d9e4308b4d891d38.jpg not downloaded yet
2026-03-27 11:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with identifier: HL95749
2026-03-27 11:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with identifier: HL95749
2026-03-27 11:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with identifier: HL95749 to the API
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:20:12Z',
 'fuel_type': 'diesel',
 'id': 'ce52f5ce-1b5d-58ca-9610-cea76740a1b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL95749',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 93933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-04',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 HDi 330 L1H2 Komfort HDi 130',
 'transmission': 'manual',
 'trim': '330 L1H2 Komfort HDi 130',
 'year': 2015}
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-27 11:31:37 [auto1.be] INFO: Saving data for HL95749: {'auction_closing_time': 1774714812.0, 'created_time': 1774265466.227732, 'last_price_update_time': 1774611097.980781}
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HL95749') HTTP/1.1" 204 0
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0eac590>
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e4dbaf1-f583-5eb7-8003-503b2df93d53/7e4dbaf1-f583-5eb7-8003-503b2df93d53_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fa3%252F30a307f37e4ac500013d18a70601844b%252Fpa%252FMS23670_695f390e4694ce5d0a078577cba82464.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_695f390e4694ce5d0a078577cba82464.jpg saved to cache
2026-03-27 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0bc70d0>
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_97adcc73c2be819d7f542151a720cd7f.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_97adcc73c2be819d7f542151a720cd7f.jpg saved to cache
2026-03-27 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a43692e3-7ce1-5b7d-86ec-bd984af3288e
2026-03-27 11:31:38 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-27 11:31:38 [auto1.be] INFO: Scrape type for CB86664: 2
2026-03-27 11:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab8f4039-3298-571a-9f56-fb3bf3761e99 with identifier: CB86664
2026-03-27 11:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab8f4039-3298-571a-9f56-fb3bf3761e99 with scrape type 2
2026-03-27 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab8f4039-3298-571a-9f56-fb3bf3761e99 with scrape type 2
2026-03-27 11:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ab8f4039-3298-571a-9f56-fb3bf3761e99, identifier: CB86664
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb9%252Fe1b93163c3985920274f0ea74b7f92a1%252Fpa%252FLP07116_c1688945de4e1d749b8410877d3bdd2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_c1688945de4e1d749b8410877d3bdd2f.jpg not downloaded yet
2026-03-27 11:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_fe6cbc6d01f3022adb51381859970a59.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_d4889e04fb2af5330a748c20280fd1c4.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ab8f4039-3298-571a-9f56-fb3bf3761e99 with identifier: CB86664
2026-03-27 11:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ab8f4039-3298-571a-9f56-fb3bf3761e99 with identifier: CB86664
2026-03-27 11:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ab8f4039-3298-571a-9f56-fb3bf3761e99 with identifier: CB86664 to the API
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:38:32Z',
 'fuel_type': 'petrol',
 'id': 'ab8f4039-3298-571a-9f56-fb3bf3761e99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB86664',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 103072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Ultimate',
 'transmission': 'manual',
 'trim': 'Ultimate',
 'year': 2022}
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-27 11:31:38 [auto1.be] INFO: Saving data for CB86664: {'auction_closing_time': 1774715912.0, 'created_time': 1773866591.722398, 'last_price_update_time': 1774611098.609903}
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB86664') HTTP/1.1" 204 0
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0cd4510>
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e4dbaf1-f583-5eb7-8003-503b2df93d53/7e4dbaf1-f583-5eb7-8003-503b2df93d53_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fa3%252F30a307f37e4ac500013d18a70601844b%252Fpa%252FMS23670_97a324099d9a5641c3ae24a1576d3789.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_97a324099d9a5641c3ae24a1576d3789.jpg saved to cache
2026-03-27 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3ce9850>
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e4dbaf1-f583-5eb7-8003-503b2df93d53/7e4dbaf1-f583-5eb7-8003-503b2df93d53_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fa3%252F30a307f37e4ac500013d18a70601844b%252Fpa%252FMS23670_213e2bd5540db541003894f9d88ee58c.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_213e2bd5540db541003894f9d88ee58c.jpg saved to cache
2026-03-27 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53
2026-03-27 11:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_70dada0422f1ca9be8a5edf87feaa12e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_6f8a3b664246a54547738bd54db23d5f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:38 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-27 11:31:38 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-27 11:31:38 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-27 11:31:38 [auto1.be] INFO: Scrape type for CA72484: 0
2026-03-27 11:31:38 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-27 11:31:38 [auto1.be] INFO: Scrape type for LG37246: 2
2026-03-27 11:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with identifier: LG37246
2026-03-27 11:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with scrape type 2
2026-03-27 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with scrape type 2
2026-03-27 11:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df, identifier: LG37246
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb9%252Fe1b93163c3985920274f0ea74b7f92a1%252Fpa%252FLP07116_ee5d66a77d593b99a1b784f91f7c4e0c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_ee5d66a77d593b99a1b784f91f7c4e0c.jpg not downloaded yet
2026-03-27 11:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with identifier: LG37246
2026-03-27 11:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with identifier: LG37246
2026-03-27 11:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with identifier: LG37246 to the API
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:54:44Z',
 'fuel_type': 'diesel',
 'id': '9a889c8a-1f00-5397-a9ff-f61e47b2d1df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG37246',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 98367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2012}
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-27 11:31:39 [auto1.be] INFO: Saving data for LG37246: {'auction_closing_time': 1774716884.0, 'created_time': 1773747312.111392, 'last_price_update_time': 1774611099.259195}
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LG37246') HTTP/1.1" 204 0
2026-03-27 11:31:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_5483511b844eca2670f85da92207885d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:39 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-27 11:31:39 [auto1.be] INFO: Scrape type for PF95077: 2
2026-03-27 11:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b2988d4-1154-5132-92c8-31545762130b with identifier: PF95077
2026-03-27 11:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b2988d4-1154-5132-92c8-31545762130b with scrape type 2
2026-03-27 11:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b2988d4-1154-5132-92c8-31545762130b with scrape type 2
2026-03-27 11:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3b2988d4-1154-5132-92c8-31545762130b, identifier: PF95077
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0efbc90>
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1/b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb9%252Fe1b93163c3985920274f0ea74b7f92a1%252Fpa%252FLP07116_fe6cbc6d01f3022adb51381859970a59.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_fe6cbc6d01f3022adb51381859970a59.jpg saved to cache
2026-03-27 11:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c806d0>
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e4dbaf1-f583-5eb7-8003-503b2df93d53/7e4dbaf1-f583-5eb7-8003-503b2df93d53_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fa3%252F30a307f37e4ac500013d18a70601844b%252Fpa%252FMS23670_d4889e04fb2af5330a748c20280fd1c4.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_d4889e04fb2af5330a748c20280fd1c4.jpg saved to cache
2026-03-27 11:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53
2026-03-27 11:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_a9d16000472bdf568874345431502fdb.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3b2988d4-1154-5132-92c8-31545762130b with identifier: PF95077
2026-03-27 11:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3b2988d4-1154-5132-92c8-31545762130b with identifier: PF95077
2026-03-27 11:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3b2988d4-1154-5132-92c8-31545762130b with identifier: PF95077 to the API
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:26:06Z',
 'fuel_type': 'diesel',
 'id': '3b2988d4-1154-5132-92c8-31545762130b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF95077',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 202592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-24',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-27 11:31:39 [auto1.be] INFO: Saving data for PF95077: {'auction_closing_time': 1774715166.0, 'created_time': 1773237022.44888, 'last_price_update_time': 1774611099.78934}
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PF95077') HTTP/1.1" 204 0
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0f36050>
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e4dbaf1-f583-5eb7-8003-503b2df93d53/7e4dbaf1-f583-5eb7-8003-503b2df93d53_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fa3%252F30a307f37e4ac500013d18a70601844b%252Fpa%252FMS23670_70dada0422f1ca9be8a5edf87feaa12e.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_70dada0422f1ca9be8a5edf87feaa12e.jpg saved to cache
2026-03-27 11:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e0aed0>
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1/b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb9%252Fe1b93163c3985920274f0ea74b7f92a1%252Fpa%252FLP07116_6f8a3b664246a54547738bd54db23d5f.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_6f8a3b664246a54547738bd54db23d5f.jpg saved to cache
2026-03-27 11:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1
2026-03-27 11:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_ced690b1173e1d0686c6d95c287ba024.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_4f447bce8f3ba4d7d9e4308b4d891d38.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:39 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-27 11:31:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f3029210>
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc8%252Fdbc8c480c4c4cb9aa7fe4af200060e3b%252Fpa%252FSC85120_5483511b844eca2670f85da92207885d.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_5483511b844eca2670f85da92207885d.jpg saved to cache
2026-03-27 11:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f350627-37d4-5531-94ae-9eb0c0194e94
2026-03-27 11:31:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f350627-37d4-5531-94ae-9eb0c0194e94, skipping ID generation
2026-03-27 11:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f350627-37d4-5531-94ae-9eb0c0194e94 with scrape type 1
2026-03-27 11:31:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f350627-37d4-5531-94ae-9eb0c0194e94 sending to next pipeline
2026-03-27 11:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f350627-37d4-5531-94ae-9eb0c0194e94, identifier: SC85120
2026-03-27 11:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_c1688945de4e1d749b8410877d3bdd2f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f350627-37d4-5531-94ae-9eb0c0194e94 with identifier: SC85120
2026-03-27 11:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f350627-37d4-5531-94ae-9eb0c0194e94 with identifier: SC85120
2026-03-27 11:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f350627-37d4-5531-94ae-9eb0c0194e94 with identifier: SC85120 to the API
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_5483511b844eca2670f85da92207885d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:08:03Z',
 'fuel_type': 'diesel',
 'id': '8f350627-37d4-5531-94ae-9eb0c0194e94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC85120',
 'listing': 'auction',
 'location': 'BE, SAINT-MARC',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 185071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_cc039154eaaba8fb98687f10734f4cef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_d970844f55b295f8fc5d160975913d4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_342a766ae826052c40d7c99ec3ebd621.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_1c6966ae4a13f3531335007375ca5267.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2470205,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_5483511b844eca2670f85da92207885d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_45191c09727c0eebbd2b39276d8bcf12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_b7c128bd0f42a7c338b61a287247915c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_a196ceae5a09fae82f24ed7fb05030e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_e455556d6a6b617c5b7c1b2ce4f75918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f350627-37d4-5531-94ae-9eb0c0194e94/8f350627-37d4-5531-94ae-9eb0c0194e94_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c8/dbc8c480c4c4cb9aa7fe4af200060e3b/pa/SC85120_8e9e06c377beb2fb3487386c7f86fb98.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-27 11:31:40 [auto1.be] INFO: Saving data for SC85120: {'created_time': 1774611100.495429, 'last_price_update_time': 1774611100.495439, 'auction_closing_time': 1774714083.0}
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC85120') HTTP/1.1" 204 0
2026-03-27 11:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d9ab90>
2026-03-27 11:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e4dbaf1-f583-5eb7-8003-503b2df93d53/7e4dbaf1-f583-5eb7-8003-503b2df93d53_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fa3%252F30a307f37e4ac500013d18a70601844b%252Fpa%252FMS23670_a9d16000472bdf568874345431502fdb.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_a9d16000472bdf568874345431502fdb.jpg saved to cache
2026-03-27 11:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53
2026-03-27 11:31:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e4dbaf1-f583-5eb7-8003-503b2df93d53, skipping ID generation
2026-03-27 11:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with scrape type 1
2026-03-27 11:31:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53 sending to next pipeline
2026-03-27 11:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e4dbaf1-f583-5eb7-8003-503b2df93d53, identifier: MS23670
2026-03-27 11:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_ee5d66a77d593b99a1b784f91f7c4e0c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC36479> (referer: https://www.auto1.com/v1/car-details-view/SC36479/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with identifier: MS23670
2026-03-27 11:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with identifier: MS23670
2026-03-27 11:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with identifier: MS23670 to the API
2026-03-27 11:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_a9d16000472bdf568874345431502fdb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:14:53Z',
 'fuel_type': 'diesel',
 'id': '7e4dbaf1-f583-5eb7-8003-503b2df93d53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS23670',
 'listing': 'auction',
 'location': 'BE, Wommelgem',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 243700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e4dbaf1-f583-5eb7-8003-503b2df93d53/7e4dbaf1-f583-5eb7-8003-503b2df93d53_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_695f390e4694ce5d0a078577cba82464.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e4dbaf1-f583-5eb7-8003-503b2df93d53/7e4dbaf1-f583-5eb7-8003-503b2df93d53_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_97a324099d9a5641c3ae24a1576d3789.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e4dbaf1-f583-5eb7-8003-503b2df93d53/7e4dbaf1-f583-5eb7-8003-503b2df93d53_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_213e2bd5540db541003894f9d88ee58c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e4dbaf1-f583-5eb7-8003-503b2df93d53/7e4dbaf1-f583-5eb7-8003-503b2df93d53_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_d4889e04fb2af5330a748c20280fd1c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e4dbaf1-f583-5eb7-8003-503b2df93d53/7e4dbaf1-f583-5eb7-8003-503b2df93d53_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_70dada0422f1ca9be8a5edf87feaa12e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e4dbaf1-f583-5eb7-8003-503b2df93d53/7e4dbaf1-f583-5eb7-8003-503b2df93d53_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/a3/30a307f37e4ac500013d18a70601844b/pa/MS23670_a9d16000472bdf568874345431502fdb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi TD Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-27 11:31:41 [auto1.be] INFO: Saving data for MS23670: {'created_time': 1774611101.485819, 'last_price_update_time': 1774611101.48583, 'auction_closing_time': 1774714493.0}
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MS23670') HTTP/1.1" 204 0
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b49710>
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1/b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb9%252Fe1b93163c3985920274f0ea74b7f92a1%252Fpa%252FLP07116_ced690b1173e1d0686c6d95c287ba024.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_ced690b1173e1d0686c6d95c287ba024.jpg saved to cache
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0f353d0>
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1/b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb9%252Fe1b93163c3985920274f0ea74b7f92a1%252Fpa%252FLP07116_4f447bce8f3ba4d7d9e4308b4d891d38.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_4f447bce8f3ba4d7d9e4308b4d891d38.jpg saved to cache
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3d04310>
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1/b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb9%252Fe1b93163c3985920274f0ea74b7f92a1%252Fpa%252FLP07116_c1688945de4e1d749b8410877d3bdd2f.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_c1688945de4e1d749b8410877d3bdd2f.jpg saved to cache
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1
2026-03-27 11:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG39340> (referer: https://www.auto1.com/v1/car-details-view/CG39340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK80434> (referer: https://www.auto1.com/v1/car-details-view/YK80434/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66ff44ded0>
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1/b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb9%252Fe1b93163c3985920274f0ea74b7f92a1%252Fpa%252FLP07116_ee5d66a77d593b99a1b784f91f7c4e0c.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_ee5d66a77d593b99a1b784f91f7c4e0c.jpg saved to cache
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1
2026-03-27 11:31:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1, skipping ID generation
2026-03-27 11:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with scrape type 1
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 sending to next pipeline
2026-03-27 11:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1, identifier: LP07116
2026-03-27 11:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with identifier: SC36479
2026-03-27 11:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with scrape type 1
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c20e58cc-3c8a-5caf-80e0-d82acc0d8396
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F79%252F4f79ccbc400a1b9333f6551226f4484e%252Fpa%252FSC36479_438f095cbad2e0715199d6b3285e87e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_438f095cbad2e0715199d6b3285e87e3.jpg already downloaded
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F79%252F4f79ccbc400a1b9333f6551226f4484e%252Fpa%252FSC36479_1e2f7b955bbf8dc3dbddba3f87358879.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_1e2f7b955bbf8dc3dbddba3f87358879.jpg already downloaded
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F79%252F4f79ccbc400a1b9333f6551226f4484e%252Fpa%252FSC36479_293762f8a1c67c776fbdf6d6e267da75.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_293762f8a1c67c776fbdf6d6e267da75.jpg already downloaded
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F79%252F4f79ccbc400a1b9333f6551226f4484e%252Fpa%252FSC36479_5e82e3eeebfd99afb60b19716b8a3829.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_5e82e3eeebfd99afb60b19716b8a3829.jpg already downloaded
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F79%252F4f79ccbc400a1b9333f6551226f4484e%252Fpa%252FSC36479_a38e475de2ee6e41c5b2805cb88e8d25.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_a38e475de2ee6e41c5b2805cb88e8d25.jpg already downloaded
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F79%252F4f79ccbc400a1b9333f6551226f4484e%252Fpa%252FSC36479_ca43354191381247cf4d7d53b748bccb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_ca43354191381247cf4d7d53b748bccb.jpg already downloaded
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F79%252F4f79ccbc400a1b9333f6551226f4484e%252Fpa%252FSC36479_9fa8461c5137c54d2186b9174e609001.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_9fa8461c5137c54d2186b9174e609001.jpg already downloaded
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F79%252F4f79ccbc400a1b9333f6551226f4484e%252Fpa%252FSC36479_181e49c49f44cbe5c7e84629f4b08139.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_181e49c49f44cbe5c7e84629f4b08139.jpg already downloaded
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F79%252F4f79ccbc400a1b9333f6551226f4484e%252Fpa%252FSC36479_8af9096778e99612f4f639c18c2ff064.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_8af9096778e99612f4f639c18c2ff064.jpg already downloaded
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F79%252F4f79ccbc400a1b9333f6551226f4484e%252Fpa%252FSC36479_721c98ec3339a09ac6cf8289449c288b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_721c98ec3339a09ac6cf8289449c288b.jpg already downloaded
2026-03-27 11:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c20e58cc-3c8a-5caf-80e0-d82acc0d8396, identifier: SC36479
2026-03-27 11:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_e1fb278641755fbe1778f1987bbd3f5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with identifier: LP07116
2026-03-27 11:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with identifier: LP07116
2026-03-27 11:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with identifier: LP07116 to the API
2026-03-27 11:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_ee5d66a77d593b99a1b784f91f7c4e0c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:08:18Z',
 'fuel_type': 'diesel',
 'id': 'b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP07116',
 'listing': 'auction',
 'location': 'BE, Waver',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 189459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1/b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_fe6cbc6d01f3022adb51381859970a59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1/b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_6f8a3b664246a54547738bd54db23d5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1/b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_ced690b1173e1d0686c6d95c287ba024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1/b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_4f447bce8f3ba4d7d9e4308b4d891d38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1/b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_c1688945de4e1d749b8410877d3bdd2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1/b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b9/e1b93163c3985920274f0ea74b7f92a1/pa/LP07116_ee5d66a77d593b99a1b784f91f7c4e0c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2013}
2026-03-27 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-27 11:31:42 [auto1.be] INFO: Saving data for LP07116: {'created_time': 1774611102.982642, 'last_price_update_time': 1774611102.98266, 'auction_closing_time': 1774714098.0}
2026-03-27 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP07116') HTTP/1.1" 204 0
2026-03-27 11:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with identifier: SC36479
2026-03-27 11:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with identifier: SC36479
2026-03-27 11:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with identifier: SC36479 to the API
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC36479>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:09:47Z',
 'fuel_type': 'diesel',
 'id': 'c20e58cc-3c8a-5caf-80e0-d82acc0d8396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC36479',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 58037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_438f095cbad2e0715199d6b3285e87e3.jpg',
                'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_1e2f7b955bbf8dc3dbddba3f87358879.jpg',
                'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_293762f8a1c67c776fbdf6d6e267da75.jpg',
                'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_5e82e3eeebfd99afb60b19716b8a3829.jpg',
                'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_a38e475de2ee6e41c5b2805cb88e8d25.jpg',
                'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_ca43354191381247cf4d7d53b748bccb.jpg',
                'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_9fa8461c5137c54d2186b9174e609001.jpg',
                'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_181e49c49f44cbe5c7e84629f4b08139.jpg',
                'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_8af9096778e99612f4f639c18c2ff064.jpg',
                'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_721c98ec3339a09ac6cf8289449c288b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20e58cc-3c8a-5caf-80e0-d82acc0d8396/c20e58cc-3c8a-5caf-80e0-d82acc0d8396_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_438f095cbad2e0715199d6b3285e87e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20e58cc-3c8a-5caf-80e0-d82acc0d8396/c20e58cc-3c8a-5caf-80e0-d82acc0d8396_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_1e2f7b955bbf8dc3dbddba3f87358879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20e58cc-3c8a-5caf-80e0-d82acc0d8396/c20e58cc-3c8a-5caf-80e0-d82acc0d8396_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_293762f8a1c67c776fbdf6d6e267da75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20e58cc-3c8a-5caf-80e0-d82acc0d8396/c20e58cc-3c8a-5caf-80e0-d82acc0d8396_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_5e82e3eeebfd99afb60b19716b8a3829.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20e58cc-3c8a-5caf-80e0-d82acc0d8396/c20e58cc-3c8a-5caf-80e0-d82acc0d8396_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_a38e475de2ee6e41c5b2805cb88e8d25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20e58cc-3c8a-5caf-80e0-d82acc0d8396/c20e58cc-3c8a-5caf-80e0-d82acc0d8396_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_ca43354191381247cf4d7d53b748bccb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20e58cc-3c8a-5caf-80e0-d82acc0d8396/c20e58cc-3c8a-5caf-80e0-d82acc0d8396_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_9fa8461c5137c54d2186b9174e609001.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20e58cc-3c8a-5caf-80e0-d82acc0d8396/c20e58cc-3c8a-5caf-80e0-d82acc0d8396_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_181e49c49f44cbe5c7e84629f4b08139.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20e58cc-3c8a-5caf-80e0-d82acc0d8396/c20e58cc-3c8a-5caf-80e0-d82acc0d8396_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_8af9096778e99612f4f639c18c2ff064.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20e58cc-3c8a-5caf-80e0-d82acc0d8396/c20e58cc-3c8a-5caf-80e0-d82acc0d8396_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/79/4f79ccbc400a1b9333f6551226f4484e/pa/SC36479_721c98ec3339a09ac6cf8289449c288b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-27 11:31:43 [auto1.be] INFO: Saving data for SC36479: {'created_time': 1774611103.323744, 'last_price_update_time': 1774611103.323753, 'auction_closing_time': 1774714187.0}
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC36479') HTTP/1.1" 204 0
2026-03-27 11:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8901d4f9-1143-56f6-b88e-bef041ff79f1 with identifier: CG39340
2026-03-27 11:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8901d4f9-1143-56f6-b88e-bef041ff79f1 with scrape type 1
2026-03-27 11:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8901d4f9-1143-56f6-b88e-bef041ff79f1
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_94fb9bd7b6a15bdd974eb10551b0e6b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_94fb9bd7b6a15bdd974eb10551b0e6b5.jpg not downloaded yet
2026-03-27 11:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c828c7e-bbca-5656-b090-1d8e5810870d with identifier: YK80434
2026-03-27 11:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c828c7e-bbca-5656-b090-1d8e5810870d with scrape type 1
2026-03-27 11:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c828c7e-bbca-5656-b090-1d8e5810870d
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_541ce6a92d7fc008fdb75f62963fb172.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_541ce6a92d7fc008fdb75f62963fb172.jpg not downloaded yet
2026-03-27 11:31:43 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1865 | hits on page: 40
2026-03-27 11:31:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0cab590>
2026-03-27 11:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_e1fb278641755fbe1778f1987bbd3f5c.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_e1fb278641755fbe1778f1987bbd3f5c.jpg saved to cache
2026-03-27 11:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a43692e3-7ce1-5b7d-86ec-bd984af3288e
2026-03-27 11:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_c688465fbfefbae1b7672d2aebdbf6cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_45064981cd068c904f3dfd2b319d9eb7.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_45064981cd068c904f3dfd2b319d9eb7.jpg not downloaded yet
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_6d5ebef6a3f3e2d6880bfac09a3d12a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_6d5ebef6a3f3e2d6880bfac09a3d12a9.jpg not downloaded yet
2026-03-27 11:31:43 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-27 11:31:43 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-27 11:31:43 [auto1.be] INFO: Scrape type for NC25574: 2
2026-03-27 11:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 224e1efe-488b-523a-a490-064d09792db1 with identifier: NC25574
2026-03-27 11:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 224e1efe-488b-523a-a490-064d09792db1 with scrape type 2
2026-03-27 11:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 224e1efe-488b-523a-a490-064d09792db1 with scrape type 2
2026-03-27 11:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 224e1efe-488b-523a-a490-064d09792db1, identifier: NC25574
2026-03-27 11:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 224e1efe-488b-523a-a490-064d09792db1 with identifier: NC25574
2026-03-27 11:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 224e1efe-488b-523a-a490-064d09792db1 with identifier: NC25574
2026-03-27 11:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 224e1efe-488b-523a-a490-064d09792db1 with identifier: NC25574 to the API
2026-03-27 11:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-28T16:51:40Z',
 'fuel_type': 'diesel',
 'id': '224e1efe-488b-523a-a490-064d09792db1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC25574',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 108325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Raptor',
 'year': 2021}
2026-03-27 11:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-27 11:31:44 [auto1.be] INFO: Saving data for NC25574: {'auction_closing_time': 1774716700.0, 'created_time': 1773131939.556374, 'last_price_update_time': 1774611104.92838}
2026-03-27 11:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC25574') HTTP/1.1" 204 0
2026-03-27 11:31:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_e2697fc4fd9221f21c6857e9deaca504.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_18db763e4a97951fb223dfa2c53ec6e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_18db763e4a97951fb223dfa2c53ec6e3.jpg not downloaded yet
2026-03-27 11:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_b366cfbf3aafbda41efea99faf65d664.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_b366cfbf3aafbda41efea99faf65d664.jpg not downloaded yet
2026-03-27 11:31:44 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-27 11:31:44 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-27 11:31:44 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-27 11:31:44 [auto1.be] INFO: Found listing with ID: UZ15252
2026-03-27 11:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ15252%27 HTTP/1.1" 200 None
2026-03-27 11:31:45 [auto1.be] INFO: Scrape type for UZ15252: 1
2026-03-27 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_e8da83888d8540c7d137164baf26f134.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_e8da83888d8540c7d137164baf26f134.jpg not downloaded yet
2026-03-27 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_0e007054e7e2ae17e93c32405017b3bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_0e007054e7e2ae17e93c32405017b3bd.jpg not downloaded yet
2026-03-27 11:31:45 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-27 11:31:45 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-27 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-27 11:31:45 [auto1.be] INFO: Scrape type for WP69561: 2
2026-03-27 11:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aaa1b77-9d44-59bd-9453-925cb5511883 with identifier: WP69561
2026-03-27 11:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aaa1b77-9d44-59bd-9453-925cb5511883 with scrape type 2
2026-03-27 11:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6aaa1b77-9d44-59bd-9453-925cb5511883 with scrape type 2
2026-03-27 11:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6aaa1b77-9d44-59bd-9453-925cb5511883, identifier: WP69561
2026-03-27 11:31:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e07350>
2026-03-27 11:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F4e%252Fc94e2ebb9c274e8bf47516896e5eb5d3%252Fpa%252FXT90325_c688465fbfefbae1b7672d2aebdbf6cd.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_c688465fbfefbae1b7672d2aebdbf6cd.jpg saved to cache
2026-03-27 11:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a43692e3-7ce1-5b7d-86ec-bd984af3288e
2026-03-27 11:31:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a43692e3-7ce1-5b7d-86ec-bd984af3288e, skipping ID generation
2026-03-27 11:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a43692e3-7ce1-5b7d-86ec-bd984af3288e with scrape type 1
2026-03-27 11:31:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a43692e3-7ce1-5b7d-86ec-bd984af3288e sending to next pipeline
2026-03-27 11:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a43692e3-7ce1-5b7d-86ec-bd984af3288e, identifier: XT90325
2026-03-27 11:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6aaa1b77-9d44-59bd-9453-925cb5511883 with identifier: WP69561
2026-03-27 11:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6aaa1b77-9d44-59bd-9453-925cb5511883 with identifier: WP69561
2026-03-27 11:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6aaa1b77-9d44-59bd-9453-925cb5511883 with identifier: WP69561 to the API
2026-03-27 11:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:07:16Z',
 'fuel_type': 'petrol',
 'id': '6aaa1b77-9d44-59bd-9453-925cb5511883',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP69561',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 193036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-25',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2014}
2026-03-27 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-27 11:31:46 [auto1.be] INFO: Saving data for WP69561: {'auction_closing_time': 1774714036.0, 'created_time': 1773833774.500726, 'last_price_update_time': 1774611106.428726}
2026-03-27 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP69561') HTTP/1.1" 204 0
2026-03-27 11:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a43692e3-7ce1-5b7d-86ec-bd984af3288e with identifier: XT90325
2026-03-27 11:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a43692e3-7ce1-5b7d-86ec-bd984af3288e with identifier: XT90325
2026-03-27 11:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a43692e3-7ce1-5b7d-86ec-bd984af3288e with identifier: XT90325 to the API
2026-03-27 11:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_c688465fbfefbae1b7672d2aebdbf6cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:10:17Z',
 'fuel_type': 'petrol',
 'id': 'a43692e3-7ce1-5b7d-86ec-bd984af3288e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT90325',
 'listing': 'auction',
 'location': 'BE, Oudenaarde',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 241614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_839519b2c8efcf993904809b29ba017d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2498238,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_e1fb278641755fbe1778f1987bbd3f5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_97adcc73c2be819d7f542151a720cd7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_85028ec7c51a0ea086e64e1845f4a14e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_4b7f053037250bad7bd740ed7fa4de78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_5b49771bafb6c88ead02e07116f7d982.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_fa3c840349c5e8b89224e5a07f2752d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2064772,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_c688465fbfefbae1b7672d2aebdbf6cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_3beacd9493291be70f8b8c609b824c6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a43692e3-7ce1-5b7d-86ec-bd984af3288e/a43692e3-7ce1-5b7d-86ec-bd984af3288e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/4e/c94e2ebb9c274e8bf47516896e5eb5d3/pa/XT90325_8e89aa988ae8d20e2eb83ae79d88b7f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Vision 2WD',
 'transmission': 'manual',
 'trim': 'Vision 2WD',
 'year': 2014}
2026-03-27 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-27 11:31:47 [auto1.be] INFO: Saving data for XT90325: {'created_time': 1774611107.000361, 'last_price_update_time': 1774611107.000371, 'auction_closing_time': 1774714217.0}
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT90325') HTTP/1.1" 204 0
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_1e251ef50f6ab2ebebff3e6acb7b568d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_1e251ef50f6ab2ebebff3e6acb7b568d.jpg not downloaded yet
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_f256fe769ee62f7de39bcaefa118c93d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_f256fe769ee62f7de39bcaefa118c93d.jpg not downloaded yet
2026-03-27 11:31:47 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-27 11:31:47 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-27 11:31:47 [auto1.be] INFO: Scrape type for GP69185: 2
2026-03-27 11:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with identifier: GP69185
2026-03-27 11:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with scrape type 2
2026-03-27 11:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with scrape type 2
2026-03-27 11:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb183f3c-d53b-51e0-9c08-f157fd80d1c9, identifier: GP69185
2026-03-27 11:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_94fb9bd7b6a15bdd974eb10551b0e6b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_541ce6a92d7fc008fdb75f62963fb172.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with identifier: GP69185
2026-03-27 11:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with identifier: GP69185
2026-03-27 11:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with identifier: GP69185 to the API
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:18:37Z',
 'fuel_type': 'diesel',
 'id': 'bb183f3c-d53b-51e0-9c08-f157fd80d1c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP69185',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 46569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi Mild-Hybrid 350 L4 Trend',
 'transmission': 'manual',
 'trim': '350 L4 Trend',
 'year': 2023}
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-27 11:31:47 [auto1.be] INFO: Saving data for GP69185: {'auction_closing_time': 1774714717.0, 'created_time': 1773520255.384527, 'last_price_update_time': 1774611107.943614}
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GP69185') HTTP/1.1" 204 0
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_e9350fba9343c56091540b3245b46283.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_e9350fba9343c56091540b3245b46283.jpg not downloaded yet
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_5771d2185b1c500ce647db6ba4a0b021.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_5771d2185b1c500ce647db6ba4a0b021.jpg not downloaded yet
2026-03-27 11:31:47 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-27 11:31:48 [auto1.be] INFO: Scrape type for YX48939: 1
2026-03-27 11:31:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0dae090>
2026-03-27 11:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff3%252F1bf37a0db95c6847ac20ee3217b2ff65%252Fpa%252FJS91211_e2697fc4fd9221f21c6857e9deaca504.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_e2697fc4fd9221f21c6857e9deaca504.jpg saved to cache
2026-03-27 11:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba
2026-03-27 11:31:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba, skipping ID generation
2026-03-27 11:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with scrape type 1
2026-03-27 11:31:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba sending to next pipeline
2026-03-27 11:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba, identifier: JS91211
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_9ec94006a42b88a5c620283507322792.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_9ec94006a42b88a5c620283507322792.jpg not downloaded yet
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_a95760be0650fe3182c59101a37dd725.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_a95760be0650fe3182c59101a37dd725.jpg not downloaded yet
2026-03-27 11:31:48 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-27 11:31:48 [auto1.be] INFO: Scrape type for TH19224: 2
2026-03-27 11:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f668b3b-4f59-5cf7-8358-d016400cd4ce with identifier: TH19224
2026-03-27 11:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f668b3b-4f59-5cf7-8358-d016400cd4ce with scrape type 2
2026-03-27 11:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f668b3b-4f59-5cf7-8358-d016400cd4ce with scrape type 2
2026-03-27 11:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f668b3b-4f59-5cf7-8358-d016400cd4ce, identifier: TH19224
2026-03-27 11:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with identifier: JS91211
2026-03-27 11:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with identifier: JS91211
2026-03-27 11:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with identifier: JS91211 to the API
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_e2697fc4fd9221f21c6857e9deaca504.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:55:43Z',
 'fuel_type': 'diesel',
 'id': '12e4a183-5766-5ba6-bfec-b32bcb9a25ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS91211',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 141385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_c92f4c835203b2b77403657e29053328.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_eb1ab03118e37515d30efeae94832d88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_3e17bd4c2e0fde5b1ca766822f85677c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2891351,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_e2697fc4fd9221f21c6857e9deaca504.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_71c6bd74920b610a9b47eb3839c9ad22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_987c10dd7cd87d1db03a8ba02580bbd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_dafbd83891ef8c7351a66b5adeebbde0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_06bf9e7cac5b60dd38a7e7b40b4337e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_53e50a10b2acd0c51eab48e2cf3073ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12e4a183-5766-5ba6-bfec-b32bcb9a25ba/12e4a183-5766-5ba6-bfec-b32bcb9a25ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f3/1bf37a0db95c6847ac20ee3217b2ff65/pa/JS91211_b10514eabdecccf9cb248d811f333e36.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 e-HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2015}
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-27 11:31:48 [auto1.be] INFO: Saving data for JS91211: {'created_time': 1774611108.864183, 'last_price_update_time': 1774611108.864193, 'auction_closing_time': 1774716943.0}
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS91211') HTTP/1.1" 204 0
2026-03-27 11:31:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f668b3b-4f59-5cf7-8358-d016400cd4ce with identifier: TH19224
2026-03-27 11:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f668b3b-4f59-5cf7-8358-d016400cd4ce with identifier: TH19224
2026-03-27 11:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f668b3b-4f59-5cf7-8358-d016400cd4ce with identifier: TH19224 to the API
2026-03-27 11:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:39:27Z',
 'fuel_type': 'petrol',
 'id': '8f668b3b-4f59-5cf7-8358-d016400cd4ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH19224',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 65179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-08',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2015}
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-27 11:31:51 [auto1.be] INFO: Saving data for TH19224: {'auction_closing_time': 1774715967.0, 'created_time': 1773833924.784205, 'last_price_update_time': 1774611111.274064}
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH19224') HTTP/1.1" 204 0
2026-03-27 11:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3cc0310>
2026-03-27 11:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_94fb9bd7b6a15bdd974eb10551b0e6b5.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_94fb9bd7b6a15bdd974eb10551b0e6b5.jpg saved to cache
2026-03-27 11:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8901d4f9-1143-56f6-b88e-bef041ff79f1
2026-03-27 11:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e9ea90>
2026-03-27 11:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_541ce6a92d7fc008fdb75f62963fb172.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_541ce6a92d7fc008fdb75f62963fb172.jpg saved to cache
2026-03-27 11:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c828c7e-bbca-5656-b090-1d8e5810870d
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_376e9a8b2f0969127902ec27a77972a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_376e9a8b2f0969127902ec27a77972a9.jpg not downloaded yet
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_a75a76477111d92403b1173e0423d43d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_a75a76477111d92403b1173e0423d43d.jpg not downloaded yet
2026-03-27 11:31:51 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-27 11:31:51 [auto1.be] INFO: Scrape type for XM93272: 1
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_feca96455352a7cc1f236a882893481d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_feca96455352a7cc1f236a882893481d.jpg not downloaded yet
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_9c26f6b303fa93d77b2179b818a225b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_9c26f6b303fa93d77b2179b818a225b4.jpg not downloaded yet
2026-03-27 11:31:51 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-27 11:31:51 [auto1.be] INFO: Scrape type for XJ47711: 2
2026-03-27 11:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19227997-8039-5f82-8183-48fcfde7f983 with identifier: XJ47711
2026-03-27 11:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19227997-8039-5f82-8183-48fcfde7f983 with scrape type 2
2026-03-27 11:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19227997-8039-5f82-8183-48fcfde7f983 with scrape type 2
2026-03-27 11:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 19227997-8039-5f82-8183-48fcfde7f983, identifier: XJ47711
2026-03-27 11:31:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 19227997-8039-5f82-8183-48fcfde7f983 with identifier: XJ47711
2026-03-27 11:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 19227997-8039-5f82-8183-48fcfde7f983 with identifier: XJ47711
2026-03-27 11:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 19227997-8039-5f82-8183-48fcfde7f983 with identifier: XJ47711 to the API
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:46:52Z',
 'fuel_type': 'hybrid',
 'id': '19227997-8039-5f82-8183-48fcfde7f983',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ47711',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 63370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 Plug-in Hybrid ë-EAT8 Shine Pack',
 'transmission': 'automatic',
 'trim': 'Shine Pack',
 'year': 2021}
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-27 11:31:51 [auto1.be] INFO: Saving data for XJ47711: {'auction_closing_time': 1774716412.0, 'created_time': 1773693588.366722, 'last_price_update_time': 1774611111.915754}
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ47711') HTTP/1.1" 204 0
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_7d19d06d008a095e6acb12d7ee973b32.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_7d19d06d008a095e6acb12d7ee973b32.jpg not downloaded yet
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_ad9a582950c21e46dbef6927f9675ff6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_ad9a582950c21e46dbef6927f9675ff6.jpg not downloaded yet
2026-03-27 11:31:51 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-27 11:31:51 [auto1.be] INFO: Scrape type for DB63111: 2
2026-03-27 11:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2aedc04-bdda-5b21-989c-f90552752a3d with identifier: DB63111
2026-03-27 11:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2aedc04-bdda-5b21-989c-f90552752a3d with scrape type 2
2026-03-27 11:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2aedc04-bdda-5b21-989c-f90552752a3d with scrape type 2
2026-03-27 11:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a2aedc04-bdda-5b21-989c-f90552752a3d, identifier: DB63111
2026-03-27 11:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_e9350fba9343c56091540b3245b46283.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_5771d2185b1c500ce647db6ba4a0b021.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_b366cfbf3aafbda41efea99faf65d664.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_18db763e4a97951fb223dfa2c53ec6e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a2aedc04-bdda-5b21-989c-f90552752a3d with identifier: DB63111
2026-03-27 11:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a2aedc04-bdda-5b21-989c-f90552752a3d with identifier: DB63111
2026-03-27 11:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a2aedc04-bdda-5b21-989c-f90552752a3d with identifier: DB63111 to the API
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:41:00Z',
 'fuel_type': 'petrol',
 'id': 'a2aedc04-bdda-5b21-989c-f90552752a3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB63111',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 212010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-19',
 'seller_name': None,
 'title': 'Kia Rio 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2012}
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-27 11:31:52 [auto1.be] INFO: Saving data for DB63111: {'auction_closing_time': 1774716060.0, 'created_time': 1773866464.842481, 'last_price_update_time': 1774611112.394405}
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB63111') HTTP/1.1" 204 0
2026-03-27 11:31:52 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-27 11:31:52 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-27 11:31:52 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-27 11:31:52 [auto1.be] INFO: Scrape type for NM63028: 1
2026-03-27 11:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:52 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-27 11:31:52 [auto1.be] INFO: Scrape type for EP14144: 2
2026-03-27 11:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01c72808-1ba6-5994-b029-1ddddb40490b with identifier: EP14144
2026-03-27 11:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01c72808-1ba6-5994-b029-1ddddb40490b with scrape type 2
2026-03-27 11:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01c72808-1ba6-5994-b029-1ddddb40490b with scrape type 2
2026-03-27 11:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 01c72808-1ba6-5994-b029-1ddddb40490b, identifier: EP14144
2026-03-27 11:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 01c72808-1ba6-5994-b029-1ddddb40490b with identifier: EP14144
2026-03-27 11:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 01c72808-1ba6-5994-b029-1ddddb40490b with identifier: EP14144
2026-03-27 11:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 01c72808-1ba6-5994-b029-1ddddb40490b with identifier: EP14144 to the API
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:36:13Z',
 'fuel_type': 'petrol',
 'id': '01c72808-1ba6-5994-b029-1ddddb40490b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP14144',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 119383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-17',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-27 11:31:52 [auto1.be] INFO: Saving data for EP14144: {'auction_closing_time': 1774715773.0, 'created_time': 1774265454.642219, 'last_price_update_time': 1774611112.874104}
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP14144') HTTP/1.1" 204 0
2026-03-27 11:31:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e07c90>
2026-03-27 11:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_e9350fba9343c56091540b3245b46283.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_e9350fba9343c56091540b3245b46283.jpg saved to cache
2026-03-27 11:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8901d4f9-1143-56f6-b88e-bef041ff79f1
2026-03-27 11:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b9de90>
2026-03-27 11:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_5771d2185b1c500ce647db6ba4a0b021.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_5771d2185b1c500ce647db6ba4a0b021.jpg saved to cache
2026-03-27 11:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c828c7e-bbca-5656-b090-1d8e5810870d
2026-03-27 11:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a80650>
2026-03-27 11:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_b366cfbf3aafbda41efea99faf65d664.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_b366cfbf3aafbda41efea99faf65d664.jpg saved to cache
2026-03-27 11:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c828c7e-bbca-5656-b090-1d8e5810870d
2026-03-27 11:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b4bd50>
2026-03-27 11:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_18db763e4a97951fb223dfa2c53ec6e3.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_18db763e4a97951fb223dfa2c53ec6e3.jpg saved to cache
2026-03-27 11:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8901d4f9-1143-56f6-b88e-bef041ff79f1
2026-03-27 11:31:53 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-27 11:31:53 [auto1.be] INFO: Scrape type for SA79242: 2
2026-03-27 11:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with identifier: SA79242
2026-03-27 11:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with scrape type 2
2026-03-27 11:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with scrape type 2
2026-03-27 11:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620, identifier: SA79242
2026-03-27 11:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_45064981cd068c904f3dfd2b319d9eb7.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_9ec94006a42b88a5c620283507322792.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_6d5ebef6a3f3e2d6880bfac09a3d12a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with identifier: SA79242
2026-03-27 11:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with identifier: SA79242
2026-03-27 11:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with identifier: SA79242 to the API
2026-03-27 11:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:20:08Z',
 'fuel_type': 'petrol',
 'id': 'bbe2ea34-26d2-58c8-b5f3-766ff7ec7620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA79242',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 197674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-29',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turbo Quadrifoglio Verde',
 'transmission': 'manual',
 'trim': 'Quadrifoglio Verde',
 'year': 2011}
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-27 11:31:54 [auto1.be] INFO: Saving data for SA79242: {'auction_closing_time': 1774714808.0, 'created_time': 1773237244.209865, 'last_price_update_time': 1774611114.380409}
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SA79242') HTTP/1.1" 204 0
2026-03-27 11:31:54 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1866 | hits on page: 40
2026-03-27 11:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_a95760be0650fe3182c59101a37dd725.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:54 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-27 11:31:54 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-27 11:31:54 [auto1.be] INFO: Scrape type for RR03336: 2
2026-03-27 11:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fa70c8d-d199-54f0-9df1-1d5f6845390c with identifier: RR03336
2026-03-27 11:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fa70c8d-d199-54f0-9df1-1d5f6845390c with scrape type 2
2026-03-27 11:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fa70c8d-d199-54f0-9df1-1d5f6845390c with scrape type 2
2026-03-27 11:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2fa70c8d-d199-54f0-9df1-1d5f6845390c, identifier: RR03336
2026-03-27 11:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2fa70c8d-d199-54f0-9df1-1d5f6845390c with identifier: RR03336
2026-03-27 11:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2fa70c8d-d199-54f0-9df1-1d5f6845390c with identifier: RR03336
2026-03-27 11:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2fa70c8d-d199-54f0-9df1-1d5f6845390c with identifier: RR03336 to the API
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:26:32Z',
 'fuel_type': 'diesel',
 'id': '2fa70c8d-d199-54f0-9df1-1d5f6845390c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR03336',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Liana',
 'odometer': 111306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-18',
 'seller_name': None,
 'title': 'Suzuki Liana 1.4 DDiS',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-27 11:31:54 [auto1.be] INFO: Saving data for RR03336: {'auction_closing_time': 1774715192.0, 'created_time': 1773132095.254832, 'last_price_update_time': 1774611114.953123}
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR03336') HTTP/1.1" 204 0
2026-03-27 11:31:54 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-27 11:31:54 [auto1.be] INFO: Scrape type for CP91123: 2
2026-03-27 11:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9137b048-af85-56fa-b073-cf9877a6c6b6 with identifier: CP91123
2026-03-27 11:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9137b048-af85-56fa-b073-cf9877a6c6b6 with scrape type 2
2026-03-27 11:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9137b048-af85-56fa-b073-cf9877a6c6b6 with scrape type 2
2026-03-27 11:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9137b048-af85-56fa-b073-cf9877a6c6b6, identifier: CP91123
2026-03-27 11:31:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:55 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-27 11:31:55 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-27 11:31:55 [auto1.be] INFO: Scrape type for SJ78748: 2
2026-03-27 11:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with identifier: SJ78748
2026-03-27 11:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with scrape type 2
2026-03-27 11:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with scrape type 2
2026-03-27 11:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a, identifier: SJ78748
2026-03-27 11:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9137b048-af85-56fa-b073-cf9877a6c6b6 with identifier: CP91123
2026-03-27 11:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9137b048-af85-56fa-b073-cf9877a6c6b6 with identifier: CP91123
2026-03-27 11:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9137b048-af85-56fa-b073-cf9877a6c6b6 with identifier: CP91123 to the API
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:22:08Z',
 'fuel_type': 'petrol',
 'id': '9137b048-af85-56fa-b073-cf9877a6c6b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP91123',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 190051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-19',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-27 11:31:55 [auto1.be] INFO: Saving data for CP91123: {'auction_closing_time': 1774714928.0, 'created_time': 1774297998.769522, 'last_price_update_time': 1774611115.47518}
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP91123') HTTP/1.1" 204 0
2026-03-27 11:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_feca96455352a7cc1f236a882893481d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_9c26f6b303fa93d77b2179b818a225b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with identifier: SJ78748
2026-03-27 11:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with identifier: SJ78748
2026-03-27 11:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with identifier: SJ78748 to the API
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:42:27Z',
 'fuel_type': 'diesel',
 'id': '7560812a-7c8c-5f8f-83a6-3ba82ffaae2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ78748',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 189244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-21',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-27 11:31:55 [auto1.be] INFO: Saving data for SJ78748: {'auction_closing_time': 1774716147.0, 'created_time': 1773747449.61006, 'last_price_update_time': 1774611115.800135}
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ78748') HTTP/1.1" 204 0
2026-03-27 11:31:55 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-27 11:31:55 [auto1.be] INFO: Scrape type for WK50026: 0
2026-03-27 11:31:55 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-27 11:31:55 [auto1.be] INFO: Scrape type for ZR84759: 2
2026-03-27 11:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with identifier: ZR84759
2026-03-27 11:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with scrape type 2
2026-03-27 11:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with scrape type 2
2026-03-27 11:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 06168cd0-ba08-5fa9-92ab-50b6e7211c24, identifier: ZR84759
2026-03-27 11:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c44c90>
2026-03-27 11:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_45064981cd068c904f3dfd2b319d9eb7.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_45064981cd068c904f3dfd2b319d9eb7.jpg saved to cache
2026-03-27 11:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8901d4f9-1143-56f6-b88e-bef041ff79f1
2026-03-27 11:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3cff910>
2026-03-27 11:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_9ec94006a42b88a5c620283507322792.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_9ec94006a42b88a5c620283507322792.jpg saved to cache
2026-03-27 11:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8901d4f9-1143-56f6-b88e-bef041ff79f1
2026-03-27 11:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b4f7d0>
2026-03-27 11:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_6d5ebef6a3f3e2d6880bfac09a3d12a9.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_6d5ebef6a3f3e2d6880bfac09a3d12a9.jpg saved to cache
2026-03-27 11:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c828c7e-bbca-5656-b090-1d8e5810870d
2026-03-27 11:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3d3af10>
2026-03-27 11:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_a95760be0650fe3182c59101a37dd725.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_a95760be0650fe3182c59101a37dd725.jpg saved to cache
2026-03-27 11:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c828c7e-bbca-5656-b090-1d8e5810870d
2026-03-27 11:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_a75a76477111d92403b1173e0423d43d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:56 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-27 11:31:56 [auto1.be] INFO: Scrape type for ZN76480: 1
2026-03-27 11:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with identifier: ZR84759
2026-03-27 11:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with identifier: ZR84759
2026-03-27 11:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with identifier: ZR84759 to the API
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:15:45Z',
 'fuel_type': 'petrol',
 'id': '06168cd0-ba08-5fa9-92ab-50b6e7211c24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR84759',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 140203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-15',
 'seller_name': None,
 'title': 'Chevrolet Cruze 1.8 LTZ',
 'transmission': 'manual',
 'trim': 'LTZ',
 'year': 2011}
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-27 11:31:56 [auto1.be] INFO: Saving data for ZR84759: {'auction_closing_time': 1774714545.0, 'created_time': 1773225539.157312, 'last_price_update_time': 1774611116.430237}
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR84759') HTTP/1.1" 204 0
2026-03-27 11:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_376e9a8b2f0969127902ec27a77972a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:56 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-27 11:31:56 [auto1.be] INFO: Scrape type for GD11285: 2
2026-03-27 11:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db12d969-99b5-5e66-afb2-b0420ae80955 with identifier: GD11285
2026-03-27 11:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db12d969-99b5-5e66-afb2-b0420ae80955 with scrape type 2
2026-03-27 11:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db12d969-99b5-5e66-afb2-b0420ae80955 with scrape type 2
2026-03-27 11:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db12d969-99b5-5e66-afb2-b0420ae80955, identifier: GD11285
2026-03-27 11:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM93272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_7d19d06d008a095e6acb12d7ee973b32.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:56 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-27 11:31:56 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-27 11:31:56 [auto1.be] INFO: Scrape type for BD10300: 2
2026-03-27 11:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3212e001-69af-5cee-80ea-05b81d630228 with identifier: BD10300
2026-03-27 11:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3212e001-69af-5cee-80ea-05b81d630228 with scrape type 2
2026-03-27 11:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3212e001-69af-5cee-80ea-05b81d630228 with scrape type 2
2026-03-27 11:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3212e001-69af-5cee-80ea-05b81d630228, identifier: BD10300
2026-03-27 11:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db12d969-99b5-5e66-afb2-b0420ae80955 with identifier: GD11285
2026-03-27 11:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db12d969-99b5-5e66-afb2-b0420ae80955 with identifier: GD11285
2026-03-27 11:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db12d969-99b5-5e66-afb2-b0420ae80955 with identifier: GD11285 to the API
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:50:36Z',
 'fuel_type': 'petrol',
 'id': 'db12d969-99b5-5e66-afb2-b0420ae80955',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD11285',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 79717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-04',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.2 TCe Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2015}
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-27 11:31:57 [auto1.be] INFO: Saving data for GD11285: {'auction_closing_time': 1774716636.0, 'created_time': 1773133000.887376, 'last_price_update_time': 1774611117.030013}
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GD11285') HTTP/1.1" 204 0
2026-03-27 11:31:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_ad9a582950c21e46dbef6927f9675ff6.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3212e001-69af-5cee-80ea-05b81d630228 with identifier: BD10300
2026-03-27 11:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3212e001-69af-5cee-80ea-05b81d630228 with identifier: BD10300
2026-03-27 11:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3212e001-69af-5cee-80ea-05b81d630228 with identifier: BD10300 to the API
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-28T16:57:37Z',
 'fuel_type': 'hybrid',
 'id': '3212e001-69af-5cee-80ea-05b81d630228',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD10300',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 92502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T4 Recharge Plug-in Hybrid Essential 2WD',
 'transmission': 'automatic',
 'trim': 'Essential 2WD',
 'year': 2021}
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-27 11:31:57 [auto1.be] INFO: Saving data for BD10300: {'auction_closing_time': 1774717057.0, 'created_time': 1774265429.947401, 'last_price_update_time': 1774611117.496873}
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BD10300') HTTP/1.1" 204 0
2026-03-27 11:31:57 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-27 11:31:57 [auto1.be] INFO: Scrape type for WK14396: 2
2026-03-27 11:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with identifier: WK14396
2026-03-27 11:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with scrape type 2
2026-03-27 11:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with scrape type 2
2026-03-27 11:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8, identifier: WK14396
2026-03-27 11:31:57 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-27 11:31:57 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-27 11:31:57 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-27 11:31:57 [auto1.be] INFO: Scrape type for XE15288: 2
2026-03-27 11:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with identifier: XE15288
2026-03-27 11:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with scrape type 2
2026-03-27 11:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with scrape type 2
2026-03-27 11:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f4381f0-d177-54d8-b3af-360b8f13e6f7, identifier: XE15288
2026-03-27 11:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with identifier: WK14396
2026-03-27 11:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with identifier: WK14396
2026-03-27 11:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with identifier: WK14396 to the API
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:16:17Z',
 'fuel_type': 'petrol',
 'id': 'bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK14396',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 153623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-27',
 'seller_name': None,
 'title': 'Volvo C30 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-27 11:31:58 [auto1.be] INFO: Saving data for WK14396: {'auction_closing_time': 1774714577.0, 'created_time': 1774298097.842679, 'last_price_update_time': 1774611118.107165}
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WK14396') HTTP/1.1" 204 0
2026-03-27 11:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ15252/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d94f10>
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_feca96455352a7cc1f236a882893481d.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_feca96455352a7cc1f236a882893481d.jpg saved to cache
2026-03-27 11:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8901d4f9-1143-56f6-b88e-bef041ff79f1
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3cfc650>
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_9c26f6b303fa93d77b2179b818a225b4.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_9c26f6b303fa93d77b2179b818a225b4.jpg saved to cache
2026-03-27 11:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c828c7e-bbca-5656-b090-1d8e5810870d
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0a85a90>
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_a75a76477111d92403b1173e0423d43d.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_a75a76477111d92403b1173e0423d43d.jpg saved to cache
2026-03-27 11:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c828c7e-bbca-5656-b090-1d8e5810870d
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0cb9fd0>
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_376e9a8b2f0969127902ec27a77972a9.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_376e9a8b2f0969127902ec27a77972a9.jpg saved to cache
2026-03-27 11:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8901d4f9-1143-56f6-b88e-bef041ff79f1
2026-03-27 11:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with identifier: XE15288
2026-03-27 11:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with identifier: XE15288
2026-03-27 11:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with identifier: XE15288 to the API
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:27:48Z',
 'fuel_type': 'diesel',
 'id': '1f4381f0-d177-54d8-b3af-360b8f13e6f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE15288',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 345528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-09',
 'seller_name': None,
 'title': 'BMW 5er 530d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-27 11:31:58 [auto1.be] INFO: Saving data for XE15288: {'auction_closing_time': 1774715268.0, 'created_time': 1774384386.313011, 'last_price_update_time': 1774611118.70898}
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XE15288') HTTP/1.1" 204 0
2026-03-27 11:31:58 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-27 11:31:58 [auto1.be] INFO: Scrape type for SA37733: 2
2026-03-27 11:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3f4080-cb18-5257-80df-25178c1a6d1a with identifier: SA37733
2026-03-27 11:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3f4080-cb18-5257-80df-25178c1a6d1a with scrape type 2
2026-03-27 11:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3f4080-cb18-5257-80df-25178c1a6d1a with scrape type 2
2026-03-27 11:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f3f4080-cb18-5257-80df-25178c1a6d1a, identifier: SA37733
2026-03-27 11:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM63028/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:31:58 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-27 11:31:58 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-27 11:31:58 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-27 11:31:58 [auto1.be] INFO: Scrape type for AX51995: 2
2026-03-27 11:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with identifier: AX51995
2026-03-27 11:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with scrape type 2
2026-03-27 11:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with scrape type 2
2026-03-27 11:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 39a73c7c-2447-5e92-aab5-6f3ccf58a987, identifier: AX51995
2026-03-27 11:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f3f4080-cb18-5257-80df-25178c1a6d1a with identifier: SA37733
2026-03-27 11:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f3f4080-cb18-5257-80df-25178c1a6d1a with identifier: SA37733
2026-03-27 11:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f3f4080-cb18-5257-80df-25178c1a6d1a with identifier: SA37733 to the API
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:25Z',
 'fuel_type': 'diesel',
 'id': '9f3f4080-cb18-5257-80df-25178c1a6d1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA37733',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 179836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-14',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2017}
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-27 11:31:59 [auto1.be] INFO: Saving data for SA37733: {'auction_closing_time': 1774714165.0, 'created_time': 1774265445.574342, 'last_price_update_time': 1774611119.315993}
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SA37733') HTTP/1.1" 204 0
2026-03-27 11:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0ead6d0>
2026-03-27 11:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_7d19d06d008a095e6acb12d7ee973b32.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_7d19d06d008a095e6acb12d7ee973b32.jpg saved to cache
2026-03-27 11:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8901d4f9-1143-56f6-b88e-bef041ff79f1
2026-03-27 11:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0d98e50>
2026-03-27 11:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_ad9a582950c21e46dbef6927f9675ff6.jpg') HTTP/1.1" 204 0
2026-03-27 11:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_ad9a582950c21e46dbef6927f9675ff6.jpg saved to cache
2026-03-27 11:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c828c7e-bbca-5656-b090-1d8e5810870d
2026-03-27 11:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with identifier: AX51995
2026-03-27 11:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with identifier: AX51995
2026-03-27 11:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with identifier: AX51995 to the API
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:28:27Z',
 'fuel_type': 'diesel',
 'id': '39a73c7c-2447-5e92-aab5-6f3ccf58a987',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX51995',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 115843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2019}
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-27 11:31:59 [auto1.be] INFO: Saving data for AX51995: {'auction_closing_time': 1774715307.0, 'created_time': 1773520258.113219, 'last_price_update_time': 1774611119.733276}
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX51995') HTTP/1.1" 204 0
2026-03-27 11:31:59 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-27 11:31:59 [auto1.be] INFO: Scrape type for DY28234: 2
2026-03-27 11:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with identifier: DY28234
2026-03-27 11:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with scrape type 2
2026-03-27 11:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with scrape type 2
2026-03-27 11:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134, identifier: DY28234
2026-03-27 11:31:59 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-27 11:31:59 [auto1.be] INFO: Scrape type for SR34780: 2
2026-03-27 11:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4722792-8b55-5cbb-9e50-4647aeecf256 with identifier: SR34780
2026-03-27 11:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4722792-8b55-5cbb-9e50-4647aeecf256 with scrape type 2
2026-03-27 11:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4722792-8b55-5cbb-9e50-4647aeecf256 with scrape type 2
2026-03-27 11:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4722792-8b55-5cbb-9e50-4647aeecf256, identifier: SR34780
2026-03-27 11:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with identifier: DY28234
2026-03-27 11:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with identifier: DY28234
2026-03-27 11:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with identifier: DY28234 to the API
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:07:41Z',
 'fuel_type': 'diesel',
 'id': '51e13d09-bd7d-51b2-b761-5a5a3ed5a134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY28234',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 175226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-27 11:32:00 [auto1.be] INFO: Saving data for DY28234: {'auction_closing_time': 1774714061.0, 'created_time': 1773834165.871049, 'last_price_update_time': 1774611120.292975}
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY28234') HTTP/1.1" 204 0
2026-03-27 11:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4722792-8b55-5cbb-9e50-4647aeecf256 with identifier: SR34780
2026-03-27 11:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4722792-8b55-5cbb-9e50-4647aeecf256 with identifier: SR34780
2026-03-27 11:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4722792-8b55-5cbb-9e50-4647aeecf256 with identifier: SR34780 to the API
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:25:07Z',
 'fuel_type': 'diesel',
 'id': 'f4722792-8b55-5cbb-9e50-4647aeecf256',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR34780',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 58061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-19',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Rapid Maxi Extra',
 'transmission': 'manual',
 'trim': 'Rapid Maxi Extra',
 'year': 2020}
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-27 11:32:00 [auto1.be] INFO: Saving data for SR34780: {'auction_closing_time': 1774715107.0, 'created_time': 1774254709.273744, 'last_price_update_time': 1774611120.633072}
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR34780') HTTP/1.1" 204 0
2026-03-27 11:32:00 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-27 11:32:00 [auto1.be] INFO: Scrape type for ED70069: 2
2026-03-27 11:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with identifier: ED70069
2026-03-27 11:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with scrape type 2
2026-03-27 11:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with scrape type 2
2026-03-27 11:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43, identifier: ED70069
2026-03-27 11:32:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:00 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-27 11:32:01 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-27 11:32:01 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-27 11:32:01 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-27 11:32:01 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-27 11:32:01 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-27 11:32:01 [auto1.be] INFO: Scrape type for CP91123: 0
2026-03-27 11:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with identifier: ED70069
2026-03-27 11:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with identifier: ED70069
2026-03-27 11:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with identifier: ED70069 to the API
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:28:00Z',
 'fuel_type': 'diesel',
 'id': 'ff0f0b1a-bba0-5416-b990-3a04b2bc2a43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED70069',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 89813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-27 11:32:01 [auto1.be] INFO: Saving data for ED70069: {'auction_closing_time': 1774715280.0, 'created_time': 1774297847.773704, 'last_price_update_time': 1774611121.370902}
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ED70069') HTTP/1.1" 204 0
2026-03-27 11:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:01 [auto1.be] INFO: Found listing with ID: VV01116
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV01116%27 HTTP/1.1" 200 None
2026-03-27 11:32:01 [auto1.be] INFO: Scrape type for VV01116: 2
2026-03-27 11:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34f02ea9-4cf8-593f-a2fa-5de1c6810d28 with identifier: VV01116
2026-03-27 11:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f02ea9-4cf8-593f-a2fa-5de1c6810d28 with scrape type 2
2026-03-27 11:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34f02ea9-4cf8-593f-a2fa-5de1c6810d28 with scrape type 2
2026-03-27 11:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 34f02ea9-4cf8-593f-a2fa-5de1c6810d28, identifier: VV01116
2026-03-27 11:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 34f02ea9-4cf8-593f-a2fa-5de1c6810d28 with identifier: VV01116
2026-03-27 11:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 34f02ea9-4cf8-593f-a2fa-5de1c6810d28 with identifier: VV01116
2026-03-27 11:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 34f02ea9-4cf8-593f-a2fa-5de1c6810d28 with identifier: VV01116 to the API
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:02:27Z',
 'fuel_type': 'diesel',
 'id': '34f02ea9-4cf8-593f-a2fa-5de1c6810d28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV01116',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 126618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-28',
 'seller_name': None,
 'title': 'BMW 5er 520d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV01116%27 HTTP/1.1" 200 None
2026-03-27 11:32:01 [auto1.be] INFO: Saving data for VV01116: {'auction_closing_time': 1774713747.0, 'created_time': 1773133403.364797, 'last_price_update_time': 1774611121.928907}
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VV01116') HTTP/1.1" 204 0
2026-03-27 11:32:01 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-27 11:32:01 [auto1.be] INFO: Scrape type for ST89131: 2
2026-03-27 11:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with identifier: ST89131
2026-03-27 11:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with scrape type 2
2026-03-27 11:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with scrape type 2
2026-03-27 11:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a, identifier: ST89131
2026-03-27 11:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with identifier: ST89131
2026-03-27 11:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with identifier: ST89131
2026-03-27 11:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with identifier: ST89131 to the API
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:43:32Z',
 'fuel_type': 'diesel',
 'id': 'd1dea36b-77b5-5b3e-81d5-a5d50db97f6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST89131',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 184032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-15',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi 4x2',
 'transmission': 'manual',
 'trim': '4x2',
 'year': 2013}
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-27 11:32:02 [auto1.be] INFO: Saving data for ST89131: {'auction_closing_time': 1774716212.0, 'created_time': 1773224956.501311, 'last_price_update_time': 1774611122.78467}
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ST89131') HTTP/1.1" 204 0
2026-03-27 11:32:02 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-27 11:32:02 [auto1.be] INFO: Scrape type for FJ79675: 1
2026-03-27 11:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN76480/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:02 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:02 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-27 11:32:02 [auto1.be] INFO: Found listing with ID: NY53837
2026-03-27 11:32:02 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-27 11:32:02 [auto1.be] INFO: Scrape type for WC98842: 1
2026-03-27 11:32:02 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-27 11:32:02 [auto1.be] INFO: Scrape type for FN69818: 0
2026-03-27 11:32:02 [auto1.be] INFO: Found listing with ID: RL41837
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL41837%27 HTTP/1.1" 200 None
2026-03-27 11:32:02 [auto1.be] INFO: Scrape type for RL41837: 0
2026-03-27 11:32:02 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-27 11:32:02 [auto1.be] INFO: Scrape type for VZ63754: 0
2026-03-27 11:32:02 [auto1.be] INFO: Found listing with ID: DB52098
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB52098%27 HTTP/1.1" 200 None
2026-03-27 11:32:02 [auto1.be] INFO: Scrape type for DB52098: 0
2026-03-27 11:32:02 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-27 11:32:02 [auto1.be] INFO: Scrape type for PR84870: 0
2026-03-27 11:32:02 [auto1.be] INFO: Found listing with ID: NM84983
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84983%27 HTTP/1.1" 200 None
2026-03-27 11:32:02 [auto1.be] INFO: Scrape type for NM84983: 0
2026-03-27 11:32:02 [auto1.be] INFO: Found listing with ID: TD45447
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD45447%27 HTTP/1.1" 200 None
2026-03-27 11:32:02 [auto1.be] INFO: Scrape type for TD45447: 0
2026-03-27 11:32:02 [auto1.be] INFO: Found listing with ID: MB97201
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB97201%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for MB97201: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: JF18972
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for FA61625: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for XU03064: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: GN38450
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN38450%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for GN38450: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: YA37935
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: PL26855
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL26855%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for PL26855: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for MR51068: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: BP74088
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP74088%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for BP74088: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: JJ45584
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for RA11008: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for XT87195: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for UT35373: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for XZ54371: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for AU32211: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: JE06286
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE06286%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for JE06286: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for AB83336: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR34349%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for MR34349: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: XC72414
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC72414%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for XC72414: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: RB01577
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: FA55499
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: FZ96232
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ96232%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for FZ96232: 0
2026-03-27 11:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for FH97290: 1
2026-03-27 11:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for JS18374: 1
2026-03-27 11:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YX48939/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for VF88831: 1
2026-03-27 11:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_e8da83888d8540c7d137164baf26f134.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for BC49055: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for TF03002: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for TZ99758: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for WW99205: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: FV40639
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for UX15937: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for MJ08102: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: JU84298
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for JZ88652: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for JX00156: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for EW63431: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: BC23353
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: WC70774
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC70774%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for WC70774: 0
2026-03-27 11:32:03 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-27 11:32:03 [auto1.be] INFO: Scrape type for XK61886: 0
2026-03-27 11:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_1e251ef50f6ab2ebebff3e6acb7b568d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b72010>
2026-03-27 11:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_e8da83888d8540c7d137164baf26f134.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_e8da83888d8540c7d137164baf26f134.jpg saved to cache
2026-03-27 11:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8901d4f9-1143-56f6-b88e-bef041ff79f1
2026-03-27 11:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM93272> (referer: https://www.auto1.com/v1/car-details-view/XM93272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_f256fe769ee62f7de39bcaefa118c93d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_0e007054e7e2ae17e93c32405017b3bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f2c83490>
2026-03-27 11:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F25%252F83253aca6b70a67899b6cfc538225123%252Fpa%252FCG39340_1e251ef50f6ab2ebebff3e6acb7b568d.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_1e251ef50f6ab2ebebff3e6acb7b568d.jpg saved to cache
2026-03-27 11:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8901d4f9-1143-56f6-b88e-bef041ff79f1
2026-03-27 11:32:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8901d4f9-1143-56f6-b88e-bef041ff79f1, skipping ID generation
2026-03-27 11:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8901d4f9-1143-56f6-b88e-bef041ff79f1 with scrape type 1
2026-03-27 11:32:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8901d4f9-1143-56f6-b88e-bef041ff79f1 sending to next pipeline
2026-03-27 11:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8901d4f9-1143-56f6-b88e-bef041ff79f1, identifier: CG39340
2026-03-27 11:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8901d4f9-1143-56f6-b88e-bef041ff79f1 with identifier: CG39340
2026-03-27 11:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8901d4f9-1143-56f6-b88e-bef041ff79f1 with identifier: CG39340
2026-03-27 11:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8901d4f9-1143-56f6-b88e-bef041ff79f1 with identifier: CG39340 to the API
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_1e251ef50f6ab2ebebff3e6acb7b568d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 118,
 'expiration_date': '2026-03-28T16:10:09Z',
 'fuel_type': 'petrol',
 'id': '8901d4f9-1143-56f6-b88e-bef041ff79f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG39340',
 'listing': 'auction',
 'location': 'BE, SAINT-MARC',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 51961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_94fb9bd7b6a15bdd974eb10551b0e6b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_45064981cd068c904f3dfd2b319d9eb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_18db763e4a97951fb223dfa2c53ec6e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2417344,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_e8da83888d8540c7d137164baf26f134.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2516326,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_1e251ef50f6ab2ebebff3e6acb7b568d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_e9350fba9343c56091540b3245b46283.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_9ec94006a42b88a5c620283507322792.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_376e9a8b2f0969127902ec27a77972a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_feca96455352a7cc1f236a882893481d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8901d4f9-1143-56f6-b88e-bef041ff79f1/8901d4f9-1143-56f6-b88e-bef041ff79f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/25/83253aca6b70a67899b6cfc538225123/pa/CG39340_7d19d06d008a095e6acb12d7ee973b32.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2016}
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-27 11:32:04 [auto1.be] INFO: Saving data for CG39340: {'created_time': 1774611124.513033, 'last_price_update_time': 1774611124.513043, 'auction_closing_time': 1774714209.0}
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CG39340') HTTP/1.1" 204 0
2026-03-27 11:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ79675/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS18374/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FH97290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ15252> (referer: https://www.auto1.com/v1/car-details-view/UZ15252/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC98842/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM63028> (referer: https://www.auto1.com/v1/car-details-view/NM63028/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4357a86-d4f6-5e8e-969e-664e196b38d6 with identifier: XM93272
2026-03-27 11:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4357a86-d4f6-5e8e-969e-664e196b38d6 with scrape type 1
2026-03-27 11:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4357a86-d4f6-5e8e-969e-664e196b38d6
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22475867116b531b3223f56c39b6cfe0%252Fpa%252FXM93272_ad8779a76ff0bac1fc0dc825f759728a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_ad8779a76ff0bac1fc0dc825f759728a.jpg already downloaded
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22475867116b531b3223f56c39b6cfe0%252Fpa%252FXM93272_2da66f069a95aee63294bba32e115716.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_2da66f069a95aee63294bba32e115716.jpg already downloaded
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22475867116b531b3223f56c39b6cfe0%252Fpa%252FXM93272_56e244eff46df8ed06e89c6fe5bb0684.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_56e244eff46df8ed06e89c6fe5bb0684.jpg already downloaded
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22475867116b531b3223f56c39b6cfe0%252Fpa%252FXM93272_2548d4c21e7073c7ce3633093f4d8eb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_2548d4c21e7073c7ce3633093f4d8eb3.jpg already downloaded
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22475867116b531b3223f56c39b6cfe0%252Fpa%252FXM93272_e26e5ee04dd6d8d797e78ff801b273f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_e26e5ee04dd6d8d797e78ff801b273f3.jpg already downloaded
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22475867116b531b3223f56c39b6cfe0%252Fpa%252FXM93272_5aa0b612f81150062b6200fd61c7f9d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_5aa0b612f81150062b6200fd61c7f9d2.jpg already downloaded
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22475867116b531b3223f56c39b6cfe0%252Fpa%252FXM93272_0140545e479271d5c2ceea7baf2f82cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_0140545e479271d5c2ceea7baf2f82cb.jpg already downloaded
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22475867116b531b3223f56c39b6cfe0%252Fpa%252FXM93272_03e06069b89f5b6229f68a9dc0cfb53c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_03e06069b89f5b6229f68a9dc0cfb53c.jpg already downloaded
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22475867116b531b3223f56c39b6cfe0%252Fpa%252FXM93272_af06068b9c993c67cebba5f7566b9a2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_af06068b9c993c67cebba5f7566b9a2a.jpg already downloaded
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F47%252F22475867116b531b3223f56c39b6cfe0%252Fpa%252FXM93272_be61df0d44ba20da29edd1e1757dc25c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_be61df0d44ba20da29edd1e1757dc25c.jpg already downloaded
2026-03-27 11:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4357a86-d4f6-5e8e-969e-664e196b38d6, identifier: XM93272
2026-03-27 11:32:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e00a90>
2026-03-27 11:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_f256fe769ee62f7de39bcaefa118c93d.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_f256fe769ee62f7de39bcaefa118c93d.jpg saved to cache
2026-03-27 11:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c828c7e-bbca-5656-b090-1d8e5810870d
2026-03-27 11:32:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0b01a10>
2026-03-27 11:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F38%252F4738610a8ba38219c06ec7b3992d44df%252Fpa%252FYK80434_0e007054e7e2ae17e93c32405017b3bd.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_0e007054e7e2ae17e93c32405017b3bd.jpg saved to cache
2026-03-27 11:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c828c7e-bbca-5656-b090-1d8e5810870d
2026-03-27 11:32:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c828c7e-bbca-5656-b090-1d8e5810870d, skipping ID generation
2026-03-27 11:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c828c7e-bbca-5656-b090-1d8e5810870d with scrape type 1
2026-03-27 11:32:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c828c7e-bbca-5656-b090-1d8e5810870d sending to next pipeline
2026-03-27 11:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c828c7e-bbca-5656-b090-1d8e5810870d, identifier: YK80434
2026-03-27 11:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4357a86-d4f6-5e8e-969e-664e196b38d6 with identifier: XM93272
2026-03-27 11:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4357a86-d4f6-5e8e-969e-664e196b38d6 with identifier: XM93272
2026-03-27 11:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4357a86-d4f6-5e8e-969e-664e196b38d6 with identifier: XM93272 to the API
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XM93272>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:45:27Z',
 'fuel_type': 'diesel',
 'id': 'f4357a86-d4f6-5e8e-969e-664e196b38d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM93272',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 120936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_ad8779a76ff0bac1fc0dc825f759728a.jpg',
                'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_2da66f069a95aee63294bba32e115716.jpg',
                'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_56e244eff46df8ed06e89c6fe5bb0684.jpg',
                'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_2548d4c21e7073c7ce3633093f4d8eb3.jpg',
                'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_e26e5ee04dd6d8d797e78ff801b273f3.jpg',
                'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_5aa0b612f81150062b6200fd61c7f9d2.jpg',
                'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_0140545e479271d5c2ceea7baf2f82cb.jpg',
                'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_03e06069b89f5b6229f68a9dc0cfb53c.jpg',
                'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_af06068b9c993c67cebba5f7566b9a2a.jpg',
                'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_be61df0d44ba20da29edd1e1757dc25c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4357a86-d4f6-5e8e-969e-664e196b38d6/f4357a86-d4f6-5e8e-969e-664e196b38d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_ad8779a76ff0bac1fc0dc825f759728a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4357a86-d4f6-5e8e-969e-664e196b38d6/f4357a86-d4f6-5e8e-969e-664e196b38d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_2da66f069a95aee63294bba32e115716.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4357a86-d4f6-5e8e-969e-664e196b38d6/f4357a86-d4f6-5e8e-969e-664e196b38d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_56e244eff46df8ed06e89c6fe5bb0684.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4357a86-d4f6-5e8e-969e-664e196b38d6/f4357a86-d4f6-5e8e-969e-664e196b38d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_2548d4c21e7073c7ce3633093f4d8eb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4357a86-d4f6-5e8e-969e-664e196b38d6/f4357a86-d4f6-5e8e-969e-664e196b38d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_e26e5ee04dd6d8d797e78ff801b273f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4357a86-d4f6-5e8e-969e-664e196b38d6/f4357a86-d4f6-5e8e-969e-664e196b38d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_5aa0b612f81150062b6200fd61c7f9d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4357a86-d4f6-5e8e-969e-664e196b38d6/f4357a86-d4f6-5e8e-969e-664e196b38d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_0140545e479271d5c2ceea7baf2f82cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4357a86-d4f6-5e8e-969e-664e196b38d6/f4357a86-d4f6-5e8e-969e-664e196b38d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_03e06069b89f5b6229f68a9dc0cfb53c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4357a86-d4f6-5e8e-969e-664e196b38d6/f4357a86-d4f6-5e8e-969e-664e196b38d6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_af06068b9c993c67cebba5f7566b9a2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4357a86-d4f6-5e8e-969e-664e196b38d6/f4357a86-d4f6-5e8e-969e-664e196b38d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/47/22475867116b531b3223f56c39b6cfe0/pa/XM93272_be61df0d44ba20da29edd1e1757dc25c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2017}
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-27 11:32:05 [auto1.be] INFO: Saving data for XM93272: {'created_time': 1774611125.689432, 'last_price_update_time': 1774611125.689442, 'auction_closing_time': 1774716327.0}
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XM93272') HTTP/1.1" 204 0
2026-03-27 11:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c828c7e-bbca-5656-b090-1d8e5810870d with identifier: YK80434
2026-03-27 11:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c828c7e-bbca-5656-b090-1d8e5810870d with identifier: YK80434
2026-03-27 11:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c828c7e-bbca-5656-b090-1d8e5810870d with identifier: YK80434 to the API
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_0e007054e7e2ae17e93c32405017b3bd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:09:07Z',
 'fuel_type': 'petrol',
 'id': '8c828c7e-bbca-5656-b090-1d8e5810870d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK80434',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 62610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_541ce6a92d7fc008fdb75f62963fb172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_6d5ebef6a3f3e2d6880bfac09a3d12a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_b366cfbf3aafbda41efea99faf65d664.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3034406,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_0e007054e7e2ae17e93c32405017b3bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3047893,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_f256fe769ee62f7de39bcaefa118c93d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_5771d2185b1c500ce647db6ba4a0b021.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_a95760be0650fe3182c59101a37dd725.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_a75a76477111d92403b1173e0423d43d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_9c26f6b303fa93d77b2179b818a225b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c828c7e-bbca-5656-b090-1d8e5810870d/8c828c7e-bbca-5656-b090-1d8e5810870d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/38/4738610a8ba38219c06ec7b3992d44df/pa/YK80434_ad9a582950c21e46dbef6927f9675ff6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2010}
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [auto1.be] INFO: Saving data for YK80434: {'created_time': 1774611126.069394, 'last_price_update_time': 1774611126.069403, 'auction_closing_time': 1774714147.0}
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YK80434') HTTP/1.1" 204 0
2026-03-27 11:32:06 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863 with identifier: UZ15252
2026-03-27 11:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863 with scrape type 1
2026-03-27 11:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F99%252F4a995f3ddc41b01268c7316b9d7add32%252Fpa%252FUZ15252_74ca31b96e839f67e9fa550e99a85f72.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_74ca31b96e839f67e9fa550e99a85f72.jpg not downloaded yet
2026-03-27 11:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with identifier: NM63028
2026-03-27 11:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with scrape type 1
2026-03-27 11:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e12bef2-c3f5-5cd9-ab84-9081692f87e1
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe0%252F41e0afb2eecacae4d5d40933d1ba9463%252Fpa%252FNM63028_b1fca37d999c8b7492e0f2eab1555e3d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_b1fca37d999c8b7492e0f2eab1555e3d.jpg already downloaded
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe0%252F41e0afb2eecacae4d5d40933d1ba9463%252Fpa%252FNM63028_007169889c608c472ec887ec0e96d80a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_007169889c608c472ec887ec0e96d80a.jpg already downloaded
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe0%252F41e0afb2eecacae4d5d40933d1ba9463%252Fpa%252FNM63028_67124ba4e6da6f2e762abd6be5af89e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_67124ba4e6da6f2e762abd6be5af89e5.jpg already downloaded
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe0%252F41e0afb2eecacae4d5d40933d1ba9463%252Fpa%252FNM63028_3b04ae18b25690678cf1ef3027efc629.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_3b04ae18b25690678cf1ef3027efc629.jpg already downloaded
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe0%252F41e0afb2eecacae4d5d40933d1ba9463%252Fpa%252FNM63028_42622d8243ccb395d54539bb5fb70275.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_42622d8243ccb395d54539bb5fb70275.jpg already downloaded
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe0%252F41e0afb2eecacae4d5d40933d1ba9463%252Fpa%252FNM63028_eb9e9d0ad3ae7bdf60cf04f497660e8f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_eb9e9d0ad3ae7bdf60cf04f497660e8f.jpg already downloaded
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe0%252F41e0afb2eecacae4d5d40933d1ba9463%252Fpa%252FNM63028_0d4610d7b57267324140c6999589b59c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_0d4610d7b57267324140c6999589b59c.jpg already downloaded
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe0%252F41e0afb2eecacae4d5d40933d1ba9463%252Fpa%252FNM63028_ca09a23c45ceb52f8eb9ca8d9988607f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_ca09a23c45ceb52f8eb9ca8d9988607f.jpg already downloaded
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe0%252F41e0afb2eecacae4d5d40933d1ba9463%252Fpa%252FNM63028_44c2f9e797a806862cc80a770bb8dedc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_44c2f9e797a806862cc80a770bb8dedc.jpg already downloaded
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe0%252F41e0afb2eecacae4d5d40933d1ba9463%252Fpa%252FNM63028_fa5c5ad99fa65f1129a4ff84e73f377e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_fa5c5ad99fa65f1129a4ff84e73f377e.jpg already downloaded
2026-03-27 11:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1, identifier: NM63028
2026-03-27 11:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with identifier: NM63028
2026-03-27 11:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with identifier: NM63028
2026-03-27 11:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with identifier: NM63028 to the API
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NM63028>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:13:07Z',
 'fuel_type': 'petrol',
 'id': '7e12bef2-c3f5-5cd9-ab84-9081692f87e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM63028',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 129173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photo_urls': ['https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_b1fca37d999c8b7492e0f2eab1555e3d.jpg',
                'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_007169889c608c472ec887ec0e96d80a.jpg',
                'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_67124ba4e6da6f2e762abd6be5af89e5.jpg',
                'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_3b04ae18b25690678cf1ef3027efc629.jpg',
                'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_42622d8243ccb395d54539bb5fb70275.jpg',
                'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_eb9e9d0ad3ae7bdf60cf04f497660e8f.jpg',
                'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_0d4610d7b57267324140c6999589b59c.jpg',
                'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_ca09a23c45ceb52f8eb9ca8d9988607f.jpg',
                'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_44c2f9e797a806862cc80a770bb8dedc.jpg',
                'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_fa5c5ad99fa65f1129a4ff84e73f377e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e12bef2-c3f5-5cd9-ab84-9081692f87e1/7e12bef2-c3f5-5cd9-ab84-9081692f87e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_b1fca37d999c8b7492e0f2eab1555e3d.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e12bef2-c3f5-5cd9-ab84-9081692f87e1/7e12bef2-c3f5-5cd9-ab84-9081692f87e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_007169889c608c472ec887ec0e96d80a.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e12bef2-c3f5-5cd9-ab84-9081692f87e1/7e12bef2-c3f5-5cd9-ab84-9081692f87e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_67124ba4e6da6f2e762abd6be5af89e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e12bef2-c3f5-5cd9-ab84-9081692f87e1/7e12bef2-c3f5-5cd9-ab84-9081692f87e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_3b04ae18b25690678cf1ef3027efc629.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e12bef2-c3f5-5cd9-ab84-9081692f87e1/7e12bef2-c3f5-5cd9-ab84-9081692f87e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_42622d8243ccb395d54539bb5fb70275.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e12bef2-c3f5-5cd9-ab84-9081692f87e1/7e12bef2-c3f5-5cd9-ab84-9081692f87e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_eb9e9d0ad3ae7bdf60cf04f497660e8f.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e12bef2-c3f5-5cd9-ab84-9081692f87e1/7e12bef2-c3f5-5cd9-ab84-9081692f87e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_0d4610d7b57267324140c6999589b59c.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e12bef2-c3f5-5cd9-ab84-9081692f87e1/7e12bef2-c3f5-5cd9-ab84-9081692f87e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_ca09a23c45ceb52f8eb9ca8d9988607f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e12bef2-c3f5-5cd9-ab84-9081692f87e1/7e12bef2-c3f5-5cd9-ab84-9081692f87e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_44c2f9e797a806862cc80a770bb8dedc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e12bef2-c3f5-5cd9-ab84-9081692f87e1/7e12bef2-c3f5-5cd9-ab84-9081692f87e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e0/41e0afb2eecacae4d5d40933d1ba9463/pa/NM63028_fa5c5ad99fa65f1129a4ff84e73f377e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 L1 Komfort Plus',
 'transmission': 'manual',
 'trim': 'L1 Komfort Plus',
 'year': 2016}
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [auto1.be] INFO: Saving data for NM63028: {'created_time': 1774611126.817051, 'last_price_update_time': 1774611126.817064, 'auction_closing_time': 1774714387.0}
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NM63028') HTTP/1.1" 204 0
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: KS62440
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS62440%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [auto1.be] INFO: Scrape type for KS62440: 0
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: YY00182
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY00182%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [auto1.be] INFO: Scrape type for YY00182: 0
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: CB62754
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [auto1.be] INFO: Scrape type for CH83928: 0
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [auto1.be] INFO: Scrape type for BN63741: 0
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [auto1.be] INFO: Scrape type for DW89258: 0
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA69116%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [auto1.be] INFO: Scrape type for YA69116: 0
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [auto1.be] INFO: Scrape type for TW09601: 0
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: DZ18869
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: RJ65357
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ65357%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [auto1.be] INFO: Scrape type for RJ65357: 0
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: FD01860
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD01860%27 HTTP/1.1" 200 None
2026-03-27 11:32:06 [auto1.be] INFO: Scrape type for FD01860: 0
2026-03-27 11:32:06 [auto1.be] INFO: Found listing with ID: TA63870
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA63870%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [auto1.be] INFO: Scrape type for TA63870: 0
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [auto1.be] INFO: Scrape type for UN77217: 0
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: AM99393
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ95996%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [auto1.be] INFO: Scrape type for RJ95996: 0
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU32507%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [auto1.be] INFO: Scrape type for LU32507: 0
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT44143%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [auto1.be] INFO: Scrape type for FT44143: 0
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: HF83279
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF83279%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [auto1.be] INFO: Scrape type for HF83279: 0
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: KX63098
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [auto1.be] INFO: Scrape type for DF96327: 0
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [auto1.be] INFO: Scrape type for RK82839: 0
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: WT46892
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: HR40537
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: WN00182
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF75491%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [auto1.be] INFO: Scrape type for UF75491: 0
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: JS54526
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [auto1.be] INFO: Scrape type for DH81993: 0
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: TR58381
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [auto1.be] INFO: Scrape type for ZH14429: 0
2026-03-27 11:32:07 [auto1.be] INFO: Found listing with ID: HE19111
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE19111%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [auto1.be] INFO: Scrape type for HE19111: 0
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F99%252F4a995f3ddc41b01268c7316b9d7add32%252Fpa%252FUZ15252_418dbb57a9e05db322552526572ad66e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_418dbb57a9e05db322552526572ad66e.jpg not downloaded yet
2026-03-27 11:32:07 [scrapy.extensions.logstats] INFO: Crawled 119 pages (at 40 pages/min), scraped 124 items (at 83 items/min)
2026-03-27 11:32:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 187MiB
2026-03-27 11:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN76480> (referer: https://www.auto1.com/v1/car-details-view/ZN76480/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F99%252F4a995f3ddc41b01268c7316b9d7add32%252Fpa%252FUZ15252_a5d6aeab0f4eb31868ac0385116cef62.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_a5d6aeab0f4eb31868ac0385116cef62.jpg not downloaded yet
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F99%252F4a995f3ddc41b01268c7316b9d7add32%252Fpa%252FUZ15252_0654f8120bc3e6a8609697d833166efc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_0654f8120bc3e6a8609697d833166efc.jpg not downloaded yet
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F99%252F4a995f3ddc41b01268c7316b9d7add32%252Fpa%252FUZ15252_1d38025b861d233587e8d9dfca8d81c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_1d38025b861d233587e8d9dfca8d81c4.jpg not downloaded yet
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F99%252F4a995f3ddc41b01268c7316b9d7add32%252Fpa%252FUZ15252_cda337d9d85cc3fd7ab072fe105a527e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_cda337d9d85cc3fd7ab072fe105a527e.jpg not downloaded yet
2026-03-27 11:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_74ca31b96e839f67e9fa550e99a85f72.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_418dbb57a9e05db322552526572ad66e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 034d32e7-ca29-5991-8ed9-2bb27008c1ff with identifier: ZN76480
2026-03-27 11:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 034d32e7-ca29-5991-8ed9-2bb27008c1ff with scrape type 1
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 034d32e7-ca29-5991-8ed9-2bb27008c1ff
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6ca1dbd74d739afc4db2b7d3e28e05%252Fpa%252FZN76480_943c322885830f0c26ab4a8e1a40732c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_943c322885830f0c26ab4a8e1a40732c.jpg already downloaded
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6ca1dbd74d739afc4db2b7d3e28e05%252Fpa%252FZN76480_3c838d47639867636fb000775497d2f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_3c838d47639867636fb000775497d2f5.jpg already downloaded
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6ca1dbd74d739afc4db2b7d3e28e05%252Fpa%252FZN76480_6e7e2956cf036addfb2f92827928d2d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_6e7e2956cf036addfb2f92827928d2d0.jpg already downloaded
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6ca1dbd74d739afc4db2b7d3e28e05%252Fpa%252FZN76480_bdeade2f583cba1f0ad8ab59757fba26.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_bdeade2f583cba1f0ad8ab59757fba26.jpg already downloaded
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6ca1dbd74d739afc4db2b7d3e28e05%252Fpa%252FZN76480_cc4b660343438f30619622b64bafb1ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_cc4b660343438f30619622b64bafb1ca.jpg already downloaded
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6ca1dbd74d739afc4db2b7d3e28e05%252Fpa%252FZN76480_2558a4ee5ff1af02d2bfdc262ca85de7.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_2558a4ee5ff1af02d2bfdc262ca85de7.jpg already downloaded
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6ca1dbd74d739afc4db2b7d3e28e05%252Fpa%252FZN76480_e4d5cb48bdf1d410152797645004453c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_e4d5cb48bdf1d410152797645004453c.jpg already downloaded
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6ca1dbd74d739afc4db2b7d3e28e05%252Fpa%252FZN76480_9e7bbf28496d407e8e91ff5a20e681ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_9e7bbf28496d407e8e91ff5a20e681ef.jpg already downloaded
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6ca1dbd74d739afc4db2b7d3e28e05%252Fpa%252FZN76480_396b7bb45c0b25f79a3215426b9be8ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_396b7bb45c0b25f79a3215426b9be8ba.jpg already downloaded
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6ca1dbd74d739afc4db2b7d3e28e05%252Fpa%252FZN76480_c06b816000e9e5642c09e1a5a4e1a440.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_c06b816000e9e5642c09e1a5a4e1a440.jpg already downloaded
2026-03-27 11:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 034d32e7-ca29-5991-8ed9-2bb27008c1ff, identifier: ZN76480
2026-03-27 11:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 034d32e7-ca29-5991-8ed9-2bb27008c1ff with identifier: ZN76480
2026-03-27 11:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 034d32e7-ca29-5991-8ed9-2bb27008c1ff with identifier: ZN76480
2026-03-27 11:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 034d32e7-ca29-5991-8ed9-2bb27008c1ff with identifier: ZN76480 to the API
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZN76480>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 212,
 'expiration_date': '2026-03-28T16:02:27Z',
 'fuel_type': 'diesel',
 'id': '034d32e7-ca29-5991-8ed9-2bb27008c1ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN76480',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 144963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_943c322885830f0c26ab4a8e1a40732c.jpg',
                'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_3c838d47639867636fb000775497d2f5.jpg',
                'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_6e7e2956cf036addfb2f92827928d2d0.jpg',
                'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_bdeade2f583cba1f0ad8ab59757fba26.jpg',
                'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_cc4b660343438f30619622b64bafb1ca.jpg',
                'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_2558a4ee5ff1af02d2bfdc262ca85de7.jpg',
                'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_e4d5cb48bdf1d410152797645004453c.jpg',
                'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_9e7bbf28496d407e8e91ff5a20e681ef.jpg',
                'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_396b7bb45c0b25f79a3215426b9be8ba.jpg',
                'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_c06b816000e9e5642c09e1a5a4e1a440.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034d32e7-ca29-5991-8ed9-2bb27008c1ff/034d32e7-ca29-5991-8ed9-2bb27008c1ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_943c322885830f0c26ab4a8e1a40732c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034d32e7-ca29-5991-8ed9-2bb27008c1ff/034d32e7-ca29-5991-8ed9-2bb27008c1ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_3c838d47639867636fb000775497d2f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034d32e7-ca29-5991-8ed9-2bb27008c1ff/034d32e7-ca29-5991-8ed9-2bb27008c1ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_6e7e2956cf036addfb2f92827928d2d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034d32e7-ca29-5991-8ed9-2bb27008c1ff/034d32e7-ca29-5991-8ed9-2bb27008c1ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_bdeade2f583cba1f0ad8ab59757fba26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034d32e7-ca29-5991-8ed9-2bb27008c1ff/034d32e7-ca29-5991-8ed9-2bb27008c1ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_cc4b660343438f30619622b64bafb1ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034d32e7-ca29-5991-8ed9-2bb27008c1ff/034d32e7-ca29-5991-8ed9-2bb27008c1ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_2558a4ee5ff1af02d2bfdc262ca85de7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034d32e7-ca29-5991-8ed9-2bb27008c1ff/034d32e7-ca29-5991-8ed9-2bb27008c1ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_e4d5cb48bdf1d410152797645004453c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034d32e7-ca29-5991-8ed9-2bb27008c1ff/034d32e7-ca29-5991-8ed9-2bb27008c1ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_9e7bbf28496d407e8e91ff5a20e681ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034d32e7-ca29-5991-8ed9-2bb27008c1ff/034d32e7-ca29-5991-8ed9-2bb27008c1ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_396b7bb45c0b25f79a3215426b9be8ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034d32e7-ca29-5991-8ed9-2bb27008c1ff/034d32e7-ca29-5991-8ed9-2bb27008c1ff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6ca1dbd74d739afc4db2b7d3e28e05/pa/ZN76480_c06b816000e9e5642c09e1a5a4e1a440.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Limited',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Limited',
 'year': 2022}
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-27 11:32:07 [auto1.be] INFO: Saving data for ZN76480: {'created_time': 1774611127.957654, 'last_price_update_time': 1774611127.957664, 'auction_closing_time': 1774713747.0}
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN76480') HTTP/1.1" 204 0
2026-03-27 11:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_0654f8120bc3e6a8609697d833166efc.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_a5d6aeab0f4eb31868ac0385116cef62.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_1d38025b861d233587e8d9dfca8d81c4.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_cda337d9d85cc3fd7ab072fe105a527e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF88831/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3b61b90>
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863/c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F99%252F4a995f3ddc41b01268c7316b9d7add32%252Fpa%252FUZ15252_74ca31b96e839f67e9fa550e99a85f72.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_74ca31b96e839f67e9fa550e99a85f72.jpg saved to cache
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0eae650>
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863/c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F99%252F4a995f3ddc41b01268c7316b9d7add32%252Fpa%252FUZ15252_418dbb57a9e05db322552526572ad66e.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_418dbb57a9e05db322552526572ad66e.jpg saved to cache
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0bc76d0>
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863/c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F99%252F4a995f3ddc41b01268c7316b9d7add32%252Fpa%252FUZ15252_0654f8120bc3e6a8609697d833166efc.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_0654f8120bc3e6a8609697d833166efc.jpg saved to cache
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0f18390>
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863/c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F99%252F4a995f3ddc41b01268c7316b9d7add32%252Fpa%252FUZ15252_a5d6aeab0f4eb31868ac0385116cef62.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_a5d6aeab0f4eb31868ac0385116cef62.jpg saved to cache
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863
2026-03-27 11:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YX48939> (referer: https://www.auto1.com/v1/car-details-view/YX48939/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f67000cfb50>
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863/c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F99%252F4a995f3ddc41b01268c7316b9d7add32%252Fpa%252FUZ15252_1d38025b861d233587e8d9dfca8d81c4.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_1d38025b861d233587e8d9dfca8d81c4.jpg saved to cache
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f3ad1550>
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863/c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F99%252F4a995f3ddc41b01268c7316b9d7add32%252Fpa%252FUZ15252_cda337d9d85cc3fd7ab072fe105a527e.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_cda337d9d85cc3fd7ab072fe105a527e.jpg saved to cache
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863
2026-03-27 11:32:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863, skipping ID generation
2026-03-27 11:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863 with scrape type 1
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863 sending to next pipeline
2026-03-27 11:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863, identifier: UZ15252
2026-03-27 11:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863 with identifier: UZ15252
2026-03-27 11:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863 with identifier: UZ15252
2026-03-27 11:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863 with identifier: UZ15252 to the API
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_cda337d9d85cc3fd7ab072fe105a527e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:17:48Z',
 'fuel_type': 'petrol',
 'id': 'c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ15252',
 'listing': 'auction',
 'location': 'BE, Oostende',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 78023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863/c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_74ca31b96e839f67e9fa550e99a85f72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863/c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_418dbb57a9e05db322552526572ad66e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863/c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_a5d6aeab0f4eb31868ac0385116cef62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863/c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_0654f8120bc3e6a8609697d833166efc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863/c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_1d38025b861d233587e8d9dfca8d81c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863/c7d7b58b-f8f9-5e6b-ba1e-b07bc5f72863_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/99/4a995f3ddc41b01268c7316b9d7add32/pa/UZ15252_cda337d9d85cc3fd7ab072fe105a527e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Linea Sol',
 'transmission': 'automatic',
 'trim': 'Linea Sol',
 'year': 2000}
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ15252%27 HTTP/1.1" 200 None
2026-03-27 11:32:08 [auto1.be] INFO: Saving data for UZ15252: {'created_time': 1774611128.820564, 'last_price_update_time': 1774611128.820578, 'auction_closing_time': 1774714668.0}
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UZ15252') HTTP/1.1" 204 0
2026-03-27 11:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ79675> (referer: https://www.auto1.com/v1/car-details-view/FJ79675/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dcbd62c-38df-5370-94cc-79408beef08a with identifier: YX48939
2026-03-27 11:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dcbd62c-38df-5370-94cc-79408beef08a with scrape type 1
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3dcbd62c-38df-5370-94cc-79408beef08a
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee1e4f1daabc0c13cff32a463d61fb%252Fpa%252FYX48939_0d554b8b6b11d8ac19d8da0e5ad79370.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_0d554b8b6b11d8ac19d8da0e5ad79370.jpg already downloaded
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee1e4f1daabc0c13cff32a463d61fb%252Fpa%252FYX48939_caaead3ab603b6768cb42902a07165a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_caaead3ab603b6768cb42902a07165a2.jpg already downloaded
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee1e4f1daabc0c13cff32a463d61fb%252Fpa%252FYX48939_642eb3963036607f1468cd8f1296f590.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_642eb3963036607f1468cd8f1296f590.jpg already downloaded
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee1e4f1daabc0c13cff32a463d61fb%252Fpa%252FYX48939_a92b5b5c974dee7ce4bbb18f4a5847a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_a92b5b5c974dee7ce4bbb18f4a5847a5.jpg already downloaded
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee1e4f1daabc0c13cff32a463d61fb%252Fpa%252FYX48939_f3bf52ad378cef77d9cd85af88d07101.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_f3bf52ad378cef77d9cd85af88d07101.jpg already downloaded
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee1e4f1daabc0c13cff32a463d61fb%252Fpa%252FYX48939_ffb01260396f846b257f6fa0ce0e01e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_ffb01260396f846b257f6fa0ce0e01e5.jpg already downloaded
2026-03-27 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee1e4f1daabc0c13cff32a463d61fb%252Fpa%252FYX48939_0c3fc8fcbb2b8156021a243c7b56d00f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_0c3fc8fcbb2b8156021a243c7b56d00f.jpg already downloaded
2026-03-27 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee1e4f1daabc0c13cff32a463d61fb%252Fpa%252FYX48939_08dc158640d8ae276f3d1aac2bffd68c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_08dc158640d8ae276f3d1aac2bffd68c.jpg already downloaded
2026-03-27 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee1e4f1daabc0c13cff32a463d61fb%252Fpa%252FYX48939_50c5a97531c153db46e64b6a3bac9943.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_50c5a97531c153db46e64b6a3bac9943.jpg already downloaded
2026-03-27 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee1e4f1daabc0c13cff32a463d61fb%252Fpa%252FYX48939_90d2572a5beeceac7b95e1de93d7e1df.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_90d2572a5beeceac7b95e1de93d7e1df.jpg already downloaded
2026-03-27 11:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3dcbd62c-38df-5370-94cc-79408beef08a, identifier: YX48939
2026-03-27 11:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3dcbd62c-38df-5370-94cc-79408beef08a with identifier: YX48939
2026-03-27 11:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3dcbd62c-38df-5370-94cc-79408beef08a with identifier: YX48939
2026-03-27 11:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3dcbd62c-38df-5370-94cc-79408beef08a with identifier: YX48939 to the API
2026-03-27 11:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YX48939>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:27:31Z',
 'fuel_type': 'hybrid',
 'id': '3dcbd62c-38df-5370-94cc-79408beef08a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX48939',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 36261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_0d554b8b6b11d8ac19d8da0e5ad79370.jpg',
                'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_caaead3ab603b6768cb42902a07165a2.jpg',
                'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_642eb3963036607f1468cd8f1296f590.jpg',
                'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_a92b5b5c974dee7ce4bbb18f4a5847a5.jpg',
                'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_f3bf52ad378cef77d9cd85af88d07101.jpg',
                'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_ffb01260396f846b257f6fa0ce0e01e5.jpg',
                'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_0c3fc8fcbb2b8156021a243c7b56d00f.jpg',
                'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_08dc158640d8ae276f3d1aac2bffd68c.jpg',
                'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_50c5a97531c153db46e64b6a3bac9943.jpg',
                'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_90d2572a5beeceac7b95e1de93d7e1df.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dcbd62c-38df-5370-94cc-79408beef08a/3dcbd62c-38df-5370-94cc-79408beef08a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_0d554b8b6b11d8ac19d8da0e5ad79370.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dcbd62c-38df-5370-94cc-79408beef08a/3dcbd62c-38df-5370-94cc-79408beef08a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3729232,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_caaead3ab603b6768cb42902a07165a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dcbd62c-38df-5370-94cc-79408beef08a/3dcbd62c-38df-5370-94cc-79408beef08a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3245866,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_642eb3963036607f1468cd8f1296f590.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dcbd62c-38df-5370-94cc-79408beef08a/3dcbd62c-38df-5370-94cc-79408beef08a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_a92b5b5c974dee7ce4bbb18f4a5847a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dcbd62c-38df-5370-94cc-79408beef08a/3dcbd62c-38df-5370-94cc-79408beef08a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3374240,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_f3bf52ad378cef77d9cd85af88d07101.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dcbd62c-38df-5370-94cc-79408beef08a/3dcbd62c-38df-5370-94cc-79408beef08a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3423260,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_ffb01260396f846b257f6fa0ce0e01e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dcbd62c-38df-5370-94cc-79408beef08a/3dcbd62c-38df-5370-94cc-79408beef08a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3056040,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_0c3fc8fcbb2b8156021a243c7b56d00f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dcbd62c-38df-5370-94cc-79408beef08a/3dcbd62c-38df-5370-94cc-79408beef08a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3403504,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_08dc158640d8ae276f3d1aac2bffd68c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dcbd62c-38df-5370-94cc-79408beef08a/3dcbd62c-38df-5370-94cc-79408beef08a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3365589,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_50c5a97531c153db46e64b6a3bac9943.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dcbd62c-38df-5370-94cc-79408beef08a/3dcbd62c-38df-5370-94cc-79408beef08a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee1e4f1daabc0c13cff32a463d61fb/pa/YX48939_90d2572a5beeceac7b95e1de93d7e1df.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-27 11:32:10 [auto1.be] INFO: Saving data for YX48939: {'created_time': 1774611130.548507, 'last_price_update_time': 1774611130.548518, 'auction_closing_time': 1774715251.0}
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YX48939') HTTP/1.1" 204 0
2026-03-27 11:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC98842> (referer: https://www.auto1.com/v1/car-details-view/WC98842/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FH97290> (referer: https://www.auto1.com/v1/car-details-view/FH97290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS18374> (referer: https://www.auto1.com/v1/car-details-view/JS18374/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 200cd7dd-45c7-51ab-846b-27b49601aaf7 with identifier: FJ79675
2026-03-27 11:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200cd7dd-45c7-51ab-846b-27b49601aaf7 with scrape type 1
2026-03-27 11:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 200cd7dd-45c7-51ab-846b-27b49601aaf7
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff1%252F1bf107cb8d4108bdc2d0283abe77682f%252Fpa%252FFJ79675_bc75f09e9273cef97bc592ae170b0fc7.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_bc75f09e9273cef97bc592ae170b0fc7.jpg already downloaded
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff1%252F1bf107cb8d4108bdc2d0283abe77682f%252Fpa%252FFJ79675_b60103f90f88a03eb7fb678295ef5650.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_b60103f90f88a03eb7fb678295ef5650.jpg already downloaded
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff1%252F1bf107cb8d4108bdc2d0283abe77682f%252Fpa%252FFJ79675_99885adb96d8e1edcc7fba5081a08a31.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_99885adb96d8e1edcc7fba5081a08a31.jpg already downloaded
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff1%252F1bf107cb8d4108bdc2d0283abe77682f%252Fpa%252FFJ79675_e72b653753434d04dc95322d85aaa371.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_e72b653753434d04dc95322d85aaa371.jpg already downloaded
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff1%252F1bf107cb8d4108bdc2d0283abe77682f%252Fpa%252FFJ79675_73367c528b34167c7599d9aea9754a01.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_73367c528b34167c7599d9aea9754a01.jpg already downloaded
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff1%252F1bf107cb8d4108bdc2d0283abe77682f%252Fpa%252FFJ79675_3b7919fc7b71c45214e6cae80d7de3fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_3b7919fc7b71c45214e6cae80d7de3fe.jpg already downloaded
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff1%252F1bf107cb8d4108bdc2d0283abe77682f%252Fpa%252FFJ79675_fa00e65b2af1970e12cee9dbb63cfd38.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_fa00e65b2af1970e12cee9dbb63cfd38.jpg already downloaded
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff1%252F1bf107cb8d4108bdc2d0283abe77682f%252Fpa%252FFJ79675_52c30aef4fd588f39016e89ff827c3cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_52c30aef4fd588f39016e89ff827c3cd.jpg already downloaded
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff1%252F1bf107cb8d4108bdc2d0283abe77682f%252Fpa%252FFJ79675_e05fad9ceb5d487fee68f3ee6d6f06aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_e05fad9ceb5d487fee68f3ee6d6f06aa.jpg already downloaded
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff1%252F1bf107cb8d4108bdc2d0283abe77682f%252Fpa%252FFJ79675_e0eb81ac42da087c18b7befec4f8c5fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_e0eb81ac42da087c18b7befec4f8c5fa.jpg already downloaded
2026-03-27 11:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 200cd7dd-45c7-51ab-846b-27b49601aaf7, identifier: FJ79675
2026-03-27 11:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 200cd7dd-45c7-51ab-846b-27b49601aaf7 with identifier: FJ79675
2026-03-27 11:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 200cd7dd-45c7-51ab-846b-27b49601aaf7 with identifier: FJ79675
2026-03-27 11:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 200cd7dd-45c7-51ab-846b-27b49601aaf7 with identifier: FJ79675 to the API
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FJ79675>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:10:18Z',
 'fuel_type': 'petrol',
 'id': '200cd7dd-45c7-51ab-846b-27b49601aaf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ79675',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 115817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_bc75f09e9273cef97bc592ae170b0fc7.jpg',
                'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_b60103f90f88a03eb7fb678295ef5650.jpg',
                'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_99885adb96d8e1edcc7fba5081a08a31.jpg',
                'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_e72b653753434d04dc95322d85aaa371.jpg',
                'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_73367c528b34167c7599d9aea9754a01.jpg',
                'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_3b7919fc7b71c45214e6cae80d7de3fe.jpg',
                'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_fa00e65b2af1970e12cee9dbb63cfd38.jpg',
                'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_52c30aef4fd588f39016e89ff827c3cd.jpg',
                'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_e05fad9ceb5d487fee68f3ee6d6f06aa.jpg',
                'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_e0eb81ac42da087c18b7befec4f8c5fa.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200cd7dd-45c7-51ab-846b-27b49601aaf7/200cd7dd-45c7-51ab-846b-27b49601aaf7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2430656,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_bc75f09e9273cef97bc592ae170b0fc7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200cd7dd-45c7-51ab-846b-27b49601aaf7/200cd7dd-45c7-51ab-846b-27b49601aaf7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_b60103f90f88a03eb7fb678295ef5650.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200cd7dd-45c7-51ab-846b-27b49601aaf7/200cd7dd-45c7-51ab-846b-27b49601aaf7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_99885adb96d8e1edcc7fba5081a08a31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200cd7dd-45c7-51ab-846b-27b49601aaf7/200cd7dd-45c7-51ab-846b-27b49601aaf7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2101843,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_e72b653753434d04dc95322d85aaa371.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200cd7dd-45c7-51ab-846b-27b49601aaf7/200cd7dd-45c7-51ab-846b-27b49601aaf7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_73367c528b34167c7599d9aea9754a01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200cd7dd-45c7-51ab-846b-27b49601aaf7/200cd7dd-45c7-51ab-846b-27b49601aaf7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2440687,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_3b7919fc7b71c45214e6cae80d7de3fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200cd7dd-45c7-51ab-846b-27b49601aaf7/200cd7dd-45c7-51ab-846b-27b49601aaf7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_fa00e65b2af1970e12cee9dbb63cfd38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200cd7dd-45c7-51ab-846b-27b49601aaf7/200cd7dd-45c7-51ab-846b-27b49601aaf7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_52c30aef4fd588f39016e89ff827c3cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200cd7dd-45c7-51ab-846b-27b49601aaf7/200cd7dd-45c7-51ab-846b-27b49601aaf7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_e05fad9ceb5d487fee68f3ee6d6f06aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200cd7dd-45c7-51ab-846b-27b49601aaf7/200cd7dd-45c7-51ab-846b-27b49601aaf7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f1/1bf107cb8d4108bdc2d0283abe77682f/pa/FJ79675_e0eb81ac42da087c18b7befec4f8c5fa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 0.9 Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [auto1.be] INFO: Saving data for FJ79675: {'created_time': 1774611131.264244, 'last_price_update_time': 1774611131.264255, 'auction_closing_time': 1774714218.0}
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ79675') HTTP/1.1" 204 0
2026-03-27 11:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with identifier: WC98842
2026-03-27 11:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with scrape type 1
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66750d3f-3e98-520f-bcd4-52bf5c7783d7
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F17%252F41174fc5b0b2e762ab2f5f00575318ef%252Fpa%252FWC98842_28394330c8e78fb4636e168fda0071f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_28394330c8e78fb4636e168fda0071f0.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F17%252F41174fc5b0b2e762ab2f5f00575318ef%252Fpa%252FWC98842_9eda8c8bb8351397734325339057160f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_9eda8c8bb8351397734325339057160f.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F17%252F41174fc5b0b2e762ab2f5f00575318ef%252Fpa%252FWC98842_33078d4f69a4fcd931002bc04150efcf.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_33078d4f69a4fcd931002bc04150efcf.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F17%252F41174fc5b0b2e762ab2f5f00575318ef%252Fpa%252FWC98842_0a66b0fd397cf582e0bef4e6e9d781bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_0a66b0fd397cf582e0bef4e6e9d781bc.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F17%252F41174fc5b0b2e762ab2f5f00575318ef%252Fpa%252FWC98842_8a9478b3b98122af50c66a9d2f221fad.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_8a9478b3b98122af50c66a9d2f221fad.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F17%252F41174fc5b0b2e762ab2f5f00575318ef%252Fpa%252FWC98842_30dd89c36545b8fdc727c57308c9d2b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_30dd89c36545b8fdc727c57308c9d2b0.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F17%252F41174fc5b0b2e762ab2f5f00575318ef%252Fpa%252FWC98842_9ab172bc4a490b598507d2be1282264f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_9ab172bc4a490b598507d2be1282264f.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F17%252F41174fc5b0b2e762ab2f5f00575318ef%252Fpa%252FWC98842_253c461f90dee81ed8d6680b5946d7a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_253c461f90dee81ed8d6680b5946d7a6.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F17%252F41174fc5b0b2e762ab2f5f00575318ef%252Fpa%252FWC98842_d1a2ac7c43f7f03f52d2c21d7e28ee84.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_d1a2ac7c43f7f03f52d2c21d7e28ee84.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F17%252F41174fc5b0b2e762ab2f5f00575318ef%252Fpa%252FWC98842_0ac03be4039ddbce4aff52080ff6dc97.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_0ac03be4039ddbce4aff52080ff6dc97.jpg already downloaded
2026-03-27 11:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 66750d3f-3e98-520f-bcd4-52bf5c7783d7, identifier: WC98842
2026-03-27 11:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da5127d3-9044-5174-b42b-c727e0da4b7c with identifier: FH97290
2026-03-27 11:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da5127d3-9044-5174-b42b-c727e0da4b7c with scrape type 1
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da5127d3-9044-5174-b42b-c727e0da4b7c
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fd5%252F9dd5d517278daa735ef9dde127b4b016%252Fpa%252FFH97290_d3f0c7347daf6db1dd0446cb9325f2f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_d3f0c7347daf6db1dd0446cb9325f2f4.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fd5%252F9dd5d517278daa735ef9dde127b4b016%252Fpa%252FFH97290_abd62457dcc5bdcbeed407581e1de56e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_abd62457dcc5bdcbeed407581e1de56e.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fd5%252F9dd5d517278daa735ef9dde127b4b016%252Fpa%252FFH97290_4cd586d9721ae07828fffc090bc861af.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_4cd586d9721ae07828fffc090bc861af.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fd5%252F9dd5d517278daa735ef9dde127b4b016%252Fpa%252FFH97290_f215470075dd0d06f66d13a684142b55.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_f215470075dd0d06f66d13a684142b55.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fd5%252F9dd5d517278daa735ef9dde127b4b016%252Fpa%252FFH97290_3fa80888fa3e561611204529139270fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_3fa80888fa3e561611204529139270fa.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fd5%252F9dd5d517278daa735ef9dde127b4b016%252Fpa%252FFH97290_653797bd117a2e6f93d7601b818ceab3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_653797bd117a2e6f93d7601b818ceab3.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fd5%252F9dd5d517278daa735ef9dde127b4b016%252Fpa%252FFH97290_f8c1421783e56ac466cf8ae6c358430d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_f8c1421783e56ac466cf8ae6c358430d.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fd5%252F9dd5d517278daa735ef9dde127b4b016%252Fpa%252FFH97290_5522d8491f1dd71010ecaf32e2836a3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_5522d8491f1dd71010ecaf32e2836a3f.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fd5%252F9dd5d517278daa735ef9dde127b4b016%252Fpa%252FFH97290_ec3a2b371855098137d75636c9a78cb5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_ec3a2b371855098137d75636c9a78cb5.jpg already downloaded
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fd5%252F9dd5d517278daa735ef9dde127b4b016%252Fpa%252FFH97290_1b701e9e4976fa5fa4068ef2e437bf5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_1b701e9e4976fa5fa4068ef2e437bf5f.jpg already downloaded
2026-03-27 11:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: da5127d3-9044-5174-b42b-c727e0da4b7c, identifier: FH97290
2026-03-27 11:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b538691-ff5a-59fd-bbdf-8e023a42c42e with identifier: JS18374
2026-03-27 11:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e with scrape type 1
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd4%252F26d4ffdf038e28b723a631cfb55c9535%252Fpa%252FJS18374_ac5cb0924974caff1f3a6a043ceb91f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_ac5cb0924974caff1f3a6a043ceb91f1.jpg not downloaded yet
2026-03-27 11:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with identifier: WC98842
2026-03-27 11:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with identifier: WC98842
2026-03-27 11:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with identifier: WC98842 to the API
2026-03-27 11:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WC98842>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:15:37Z',
 'fuel_type': 'petrol',
 'id': '66750d3f-3e98-520f-bcd4-52bf5c7783d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC98842',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 118075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_28394330c8e78fb4636e168fda0071f0.jpg',
                'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_9eda8c8bb8351397734325339057160f.jpg',
                'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_33078d4f69a4fcd931002bc04150efcf.jpg',
                'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_0a66b0fd397cf582e0bef4e6e9d781bc.jpg',
                'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_8a9478b3b98122af50c66a9d2f221fad.jpg',
                'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_30dd89c36545b8fdc727c57308c9d2b0.jpg',
                'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_9ab172bc4a490b598507d2be1282264f.jpg',
                'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_253c461f90dee81ed8d6680b5946d7a6.jpg',
                'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_d1a2ac7c43f7f03f52d2c21d7e28ee84.jpg',
                'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_0ac03be4039ddbce4aff52080ff6dc97.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66750d3f-3e98-520f-bcd4-52bf5c7783d7/66750d3f-3e98-520f-bcd4-52bf5c7783d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_28394330c8e78fb4636e168fda0071f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66750d3f-3e98-520f-bcd4-52bf5c7783d7/66750d3f-3e98-520f-bcd4-52bf5c7783d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_9eda8c8bb8351397734325339057160f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66750d3f-3e98-520f-bcd4-52bf5c7783d7/66750d3f-3e98-520f-bcd4-52bf5c7783d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_33078d4f69a4fcd931002bc04150efcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66750d3f-3e98-520f-bcd4-52bf5c7783d7/66750d3f-3e98-520f-bcd4-52bf5c7783d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_0a66b0fd397cf582e0bef4e6e9d781bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66750d3f-3e98-520f-bcd4-52bf5c7783d7/66750d3f-3e98-520f-bcd4-52bf5c7783d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_8a9478b3b98122af50c66a9d2f221fad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66750d3f-3e98-520f-bcd4-52bf5c7783d7/66750d3f-3e98-520f-bcd4-52bf5c7783d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_30dd89c36545b8fdc727c57308c9d2b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66750d3f-3e98-520f-bcd4-52bf5c7783d7/66750d3f-3e98-520f-bcd4-52bf5c7783d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_9ab172bc4a490b598507d2be1282264f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66750d3f-3e98-520f-bcd4-52bf5c7783d7/66750d3f-3e98-520f-bcd4-52bf5c7783d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_253c461f90dee81ed8d6680b5946d7a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66750d3f-3e98-520f-bcd4-52bf5c7783d7/66750d3f-3e98-520f-bcd4-52bf5c7783d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_d1a2ac7c43f7f03f52d2c21d7e28ee84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66750d3f-3e98-520f-bcd4-52bf5c7783d7/66750d3f-3e98-520f-bcd4-52bf5c7783d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/17/41174fc5b0b2e762ab2f5f00575318ef/pa/WC98842_0ac03be4039ddbce4aff52080ff6dc97.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2017}
2026-03-27 11:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-27 11:32:12 [auto1.be] INFO: Saving data for WC98842: {'created_time': 1774611132.2031, 'last_price_update_time': 1774611132.20311, 'auction_closing_time': 1774714537.0}
2026-03-27 11:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC98842') HTTP/1.1" 204 0
2026-03-27 11:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: da5127d3-9044-5174-b42b-c727e0da4b7c with identifier: FH97290
2026-03-27 11:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: da5127d3-9044-5174-b42b-c727e0da4b7c with identifier: FH97290
2026-03-27 11:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: da5127d3-9044-5174-b42b-c727e0da4b7c with identifier: FH97290 to the API
2026-03-27 11:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FH97290>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:06:40Z',
 'fuel_type': 'petrol',
 'id': 'da5127d3-9044-5174-b42b-c727e0da4b7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH97290',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 59826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_d3f0c7347daf6db1dd0446cb9325f2f4.jpg',
                'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_abd62457dcc5bdcbeed407581e1de56e.jpg',
                'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_4cd586d9721ae07828fffc090bc861af.jpg',
                'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_f215470075dd0d06f66d13a684142b55.jpg',
                'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_3fa80888fa3e561611204529139270fa.jpg',
                'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_653797bd117a2e6f93d7601b818ceab3.jpg',
                'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_f8c1421783e56ac466cf8ae6c358430d.jpg',
                'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_5522d8491f1dd71010ecaf32e2836a3f.jpg',
                'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_ec3a2b371855098137d75636c9a78cb5.jpg',
                'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_1b701e9e4976fa5fa4068ef2e437bf5f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da5127d3-9044-5174-b42b-c727e0da4b7c/da5127d3-9044-5174-b42b-c727e0da4b7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_d3f0c7347daf6db1dd0446cb9325f2f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da5127d3-9044-5174-b42b-c727e0da4b7c/da5127d3-9044-5174-b42b-c727e0da4b7c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_abd62457dcc5bdcbeed407581e1de56e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da5127d3-9044-5174-b42b-c727e0da4b7c/da5127d3-9044-5174-b42b-c727e0da4b7c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_4cd586d9721ae07828fffc090bc861af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da5127d3-9044-5174-b42b-c727e0da4b7c/da5127d3-9044-5174-b42b-c727e0da4b7c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_f215470075dd0d06f66d13a684142b55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da5127d3-9044-5174-b42b-c727e0da4b7c/da5127d3-9044-5174-b42b-c727e0da4b7c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_3fa80888fa3e561611204529139270fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da5127d3-9044-5174-b42b-c727e0da4b7c/da5127d3-9044-5174-b42b-c727e0da4b7c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_653797bd117a2e6f93d7601b818ceab3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da5127d3-9044-5174-b42b-c727e0da4b7c/da5127d3-9044-5174-b42b-c727e0da4b7c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_f8c1421783e56ac466cf8ae6c358430d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da5127d3-9044-5174-b42b-c727e0da4b7c/da5127d3-9044-5174-b42b-c727e0da4b7c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_5522d8491f1dd71010ecaf32e2836a3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da5127d3-9044-5174-b42b-c727e0da4b7c/da5127d3-9044-5174-b42b-c727e0da4b7c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_ec3a2b371855098137d75636c9a78cb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da5127d3-9044-5174-b42b-c727e0da4b7c/da5127d3-9044-5174-b42b-c727e0da4b7c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/d5/9dd5d517278daa735ef9dde127b4b016/pa/FH97290_1b701e9e4976fa5fa4068ef2e437bf5f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [auto1.be] INFO: Saving data for FH97290: {'created_time': 1774611133.147032, 'last_price_update_time': 1774611133.147042, 'auction_closing_time': 1774714000.0}
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FH97290') HTTP/1.1" 204 0
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd4%252F26d4ffdf038e28b723a631cfb55c9535%252Fpa%252FJS18374_1db0a4a7a1923dbef6099fd21d444096.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_1db0a4a7a1923dbef6099fd21d444096.jpg not downloaded yet
2026-03-27 11:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF88831> (referer: https://www.auto1.com/v1/car-details-view/VF88831/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd4%252F26d4ffdf038e28b723a631cfb55c9535%252Fpa%252FJS18374_6a1788ee14c53c98fc2a99e45ee8d4f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_6a1788ee14c53c98fc2a99e45ee8d4f6.jpg not downloaded yet
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd4%252F26d4ffdf038e28b723a631cfb55c9535%252Fpa%252FJS18374_8dfb1bd7468a9dd9839ddeb3d85bf29a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_8dfb1bd7468a9dd9839ddeb3d85bf29a.jpg not downloaded yet
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd4%252F26d4ffdf038e28b723a631cfb55c9535%252Fpa%252FJS18374_5a760ce5983d6932cfee816ce9c207d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_5a760ce5983d6932cfee816ce9c207d7.jpg not downloaded yet
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd4%252F26d4ffdf038e28b723a631cfb55c9535%252Fpa%252FJS18374_3b5e305709e47a954f96421fced13686.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_3b5e305709e47a954f96421fced13686.jpg not downloaded yet
2026-03-27 11:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_ac5cb0924974caff1f3a6a043ceb91f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_6a1788ee14c53c98fc2a99e45ee8d4f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with identifier: VF88831
2026-03-27 11:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with scrape type 1
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1ae2a17-7b8d-51d1-8f5a-f01d30af17da
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F91%252F4691dea980a592a085b798314ddfbb15%252Fpa%252FVF88831_f01a5205ef7490b9a5d91eafa7c72352.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_f01a5205ef7490b9a5d91eafa7c72352.jpg already downloaded
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F91%252F4691dea980a592a085b798314ddfbb15%252Fpa%252FVF88831_0208fe96b843481569922161d3e985c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_0208fe96b843481569922161d3e985c8.jpg already downloaded
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F91%252F4691dea980a592a085b798314ddfbb15%252Fpa%252FVF88831_206d0a74cf45b3bd60673194b36677c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_206d0a74cf45b3bd60673194b36677c2.jpg already downloaded
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F91%252F4691dea980a592a085b798314ddfbb15%252Fpa%252FVF88831_4877c89f9320ece8ccfa03837536e034.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_4877c89f9320ece8ccfa03837536e034.jpg already downloaded
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F91%252F4691dea980a592a085b798314ddfbb15%252Fpa%252FVF88831_7a6dfd55b64e1476cdb673efed7b4fad.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_7a6dfd55b64e1476cdb673efed7b4fad.jpg already downloaded
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F91%252F4691dea980a592a085b798314ddfbb15%252Fpa%252FVF88831_70769222c7f5a58c23aa28d544a2363c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_70769222c7f5a58c23aa28d544a2363c.jpg already downloaded
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F91%252F4691dea980a592a085b798314ddfbb15%252Fpa%252FVF88831_e466b5225d7f28d579d91b580354dd44.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_e466b5225d7f28d579d91b580354dd44.jpg already downloaded
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F91%252F4691dea980a592a085b798314ddfbb15%252Fpa%252FVF88831_376b25f039dfb0747c4cd4cc919fe3cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_376b25f039dfb0747c4cd4cc919fe3cf.jpg already downloaded
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F91%252F4691dea980a592a085b798314ddfbb15%252Fpa%252FVF88831_80ffb57f96a6300142e6b0befe154a8a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_80ffb57f96a6300142e6b0befe154a8a.jpg already downloaded
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F91%252F4691dea980a592a085b798314ddfbb15%252Fpa%252FVF88831_06c469e672bdf5314bfe4660020250ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_06c469e672bdf5314bfe4660020250ce.jpg already downloaded
2026-03-27 11:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da, identifier: VF88831
2026-03-27 11:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with identifier: VF88831
2026-03-27 11:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with identifier: VF88831
2026-03-27 11:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with identifier: VF88831 to the API
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VF88831>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:32:39Z',
 'fuel_type': 'hybrid',
 'id': 'd1ae2a17-7b8d-51d1-8f5a-f01d30af17da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF88831',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Lexus',
 'model': 'CT-Serie',
 'odometer': 93038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_f01a5205ef7490b9a5d91eafa7c72352.jpg',
                'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_0208fe96b843481569922161d3e985c8.jpg',
                'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_206d0a74cf45b3bd60673194b36677c2.jpg',
                'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_4877c89f9320ece8ccfa03837536e034.jpg',
                'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_7a6dfd55b64e1476cdb673efed7b4fad.jpg',
                'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_70769222c7f5a58c23aa28d544a2363c.jpg',
                'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_e466b5225d7f28d579d91b580354dd44.jpg',
                'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_376b25f039dfb0747c4cd4cc919fe3cf.jpg',
                'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_80ffb57f96a6300142e6b0befe154a8a.jpg',
                'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_06c469e672bdf5314bfe4660020250ce.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1ae2a17-7b8d-51d1-8f5a-f01d30af17da/d1ae2a17-7b8d-51d1-8f5a-f01d30af17da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_f01a5205ef7490b9a5d91eafa7c72352.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1ae2a17-7b8d-51d1-8f5a-f01d30af17da/d1ae2a17-7b8d-51d1-8f5a-f01d30af17da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_0208fe96b843481569922161d3e985c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1ae2a17-7b8d-51d1-8f5a-f01d30af17da/d1ae2a17-7b8d-51d1-8f5a-f01d30af17da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_206d0a74cf45b3bd60673194b36677c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1ae2a17-7b8d-51d1-8f5a-f01d30af17da/d1ae2a17-7b8d-51d1-8f5a-f01d30af17da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_4877c89f9320ece8ccfa03837536e034.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1ae2a17-7b8d-51d1-8f5a-f01d30af17da/d1ae2a17-7b8d-51d1-8f5a-f01d30af17da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_7a6dfd55b64e1476cdb673efed7b4fad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1ae2a17-7b8d-51d1-8f5a-f01d30af17da/d1ae2a17-7b8d-51d1-8f5a-f01d30af17da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_70769222c7f5a58c23aa28d544a2363c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1ae2a17-7b8d-51d1-8f5a-f01d30af17da/d1ae2a17-7b8d-51d1-8f5a-f01d30af17da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_e466b5225d7f28d579d91b580354dd44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1ae2a17-7b8d-51d1-8f5a-f01d30af17da/d1ae2a17-7b8d-51d1-8f5a-f01d30af17da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_376b25f039dfb0747c4cd4cc919fe3cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1ae2a17-7b8d-51d1-8f5a-f01d30af17da/d1ae2a17-7b8d-51d1-8f5a-f01d30af17da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_80ffb57f96a6300142e6b0befe154a8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1ae2a17-7b8d-51d1-8f5a-f01d30af17da/d1ae2a17-7b8d-51d1-8f5a-f01d30af17da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/91/4691dea980a592a085b798314ddfbb15/pa/VF88831_06c469e672bdf5314bfe4660020250ce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus CT-Serie CT 200h Executive Line',
 'transmission': 'automatic',
 'trim': 'Executive Line',
 'year': 2013}
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [auto1.be] INFO: Saving data for VF88831: {'created_time': 1774611133.935131, 'last_price_update_time': 1774611133.935143, 'auction_closing_time': 1774715559.0}
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VF88831') HTTP/1.1" 204 0
2026-03-27 11:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_8dfb1bd7468a9dd9839ddeb3d85bf29a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:13 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_1db0a4a7a1923dbef6099fd21d444096.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_5a760ce5983d6932cfee816ce9c207d7.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_3b5e305709e47a954f96421fced13686.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:32:13 [auto1.be] INFO: Found listing with ID: NY46962
2026-03-27 11:32:13 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE06051%27 HTTP/1.1" 200 None
2026-03-27 11:32:13 [auto1.be] INFO: Scrape type for PE06051: 0
2026-03-27 11:32:13 [auto1.be] INFO: Found listing with ID: LJ80656
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ80656%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for LJ80656: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for YS48127: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: BF25955
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: UY95301
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY95301%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for UY95301: 2
2026-03-27 11:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7240145-0a58-591e-8f3b-a3a8986befd2 with identifier: UY95301
2026-03-27 11:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7240145-0a58-591e-8f3b-a3a8986befd2 with scrape type 2
2026-03-27 11:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7240145-0a58-591e-8f3b-a3a8986befd2 with scrape type 2
2026-03-27 11:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f7240145-0a58-591e-8f3b-a3a8986befd2, identifier: UY95301
2026-03-27 11:32:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c577d0>
2026-03-27 11:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b538691-ff5a-59fd-bbdf-8e023a42c42e/0b538691-ff5a-59fd-bbdf-8e023a42c42e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd4%252F26d4ffdf038e28b723a631cfb55c9535%252Fpa%252FJS18374_ac5cb0924974caff1f3a6a043ceb91f1.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_ac5cb0924974caff1f3a6a043ceb91f1.jpg saved to cache
2026-03-27 11:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e
2026-03-27 11:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0c17dd0>
2026-03-27 11:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b538691-ff5a-59fd-bbdf-8e023a42c42e/0b538691-ff5a-59fd-bbdf-8e023a42c42e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd4%252F26d4ffdf038e28b723a631cfb55c9535%252Fpa%252FJS18374_6a1788ee14c53c98fc2a99e45ee8d4f6.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_6a1788ee14c53c98fc2a99e45ee8d4f6.jpg saved to cache
2026-03-27 11:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e
2026-03-27 11:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f7240145-0a58-591e-8f3b-a3a8986befd2 with identifier: UY95301
2026-03-27 11:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f7240145-0a58-591e-8f3b-a3a8986befd2 with identifier: UY95301
2026-03-27 11:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f7240145-0a58-591e-8f3b-a3a8986befd2 with identifier: UY95301 to the API
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:16:21Z',
 'fuel_type': 'diesel',
 'id': 'f7240145-0a58-591e-8f3b-a3a8986befd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY95301',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 223649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-06',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2011}
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY95301%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Saving data for UY95301: {'auction_closing_time': 1774628181.0, 'created_time': 1774298113.591685, 'last_price_update_time': 1774611134.606018}
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY95301') HTTP/1.1" 204 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: GK93225
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for YW15851: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: UL09185
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL09185%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for UL09185: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: KE27400
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: SE96369
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE96369%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for SE96369: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: PR44884
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR44884%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for PR44884: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: TA85166
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA85166%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for TA85166: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: ZW84802
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW84802%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for ZW84802: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV95971%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for JV95971: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF11904%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for XF11904: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: RM99520
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM99520%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for RM99520: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: WZ59166
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ59166%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for WZ59166: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: VR26714
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: EC58285
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EC58285%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for EC58285: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: JD48468
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: JM95627
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM95627%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for JM95627: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: MR00470
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR00470%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for MR00470: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: RD83049
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: EJ96741
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: RZ07927
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: UM23186
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM23186%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for UM23186: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: YX93920
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX93920%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for YX93920: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: EX80528
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: VS47672
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: XP16826
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: HU32534
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU32534%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for HU32534: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: TV14945
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV14945%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for TV14945: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: NC20870
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC20870%27 HTTP/1.1" 200 None
2026-03-27 11:32:14 [auto1.be] INFO: Scrape type for NC20870: 0
2026-03-27 11:32:14 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-27 11:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3ca3610>
2026-03-27 11:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b538691-ff5a-59fd-bbdf-8e023a42c42e/0b538691-ff5a-59fd-bbdf-8e023a42c42e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd4%252F26d4ffdf038e28b723a631cfb55c9535%252Fpa%252FJS18374_8dfb1bd7468a9dd9839ddeb3d85bf29a.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_8dfb1bd7468a9dd9839ddeb3d85bf29a.jpg saved to cache
2026-03-27 11:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e
2026-03-27 11:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3c56090>
2026-03-27 11:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b538691-ff5a-59fd-bbdf-8e023a42c42e/0b538691-ff5a-59fd-bbdf-8e023a42c42e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd4%252F26d4ffdf038e28b723a631cfb55c9535%252Fpa%252FJS18374_1db0a4a7a1923dbef6099fd21d444096.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_1db0a4a7a1923dbef6099fd21d444096.jpg saved to cache
2026-03-27 11:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e
2026-03-27 11:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66e3ca3010>
2026-03-27 11:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b538691-ff5a-59fd-bbdf-8e023a42c42e/0b538691-ff5a-59fd-bbdf-8e023a42c42e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd4%252F26d4ffdf038e28b723a631cfb55c9535%252Fpa%252FJS18374_5a760ce5983d6932cfee816ce9c207d7.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_5a760ce5983d6932cfee816ce9c207d7.jpg saved to cache
2026-03-27 11:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e
2026-03-27 11:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f66f0e01050>
2026-03-27 11:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b538691-ff5a-59fd-bbdf-8e023a42c42e/0b538691-ff5a-59fd-bbdf-8e023a42c42e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd4%252F26d4ffdf038e28b723a631cfb55c9535%252Fpa%252FJS18374_3b5e305709e47a954f96421fced13686.jpg') HTTP/1.1" 204 0
2026-03-27 11:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_3b5e305709e47a954f96421fced13686.jpg saved to cache
2026-03-27 11:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e
2026-03-27 11:32:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b538691-ff5a-59fd-bbdf-8e023a42c42e, skipping ID generation
2026-03-27 11:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e with scrape type 1
2026-03-27 11:32:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e sending to next pipeline
2026-03-27 11:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0b538691-ff5a-59fd-bbdf-8e023a42c42e, identifier: JS18374
2026-03-27 11:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0b538691-ff5a-59fd-bbdf-8e023a42c42e with identifier: JS18374
2026-03-27 11:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0b538691-ff5a-59fd-bbdf-8e023a42c42e with identifier: JS18374
2026-03-27 11:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0b538691-ff5a-59fd-bbdf-8e023a42c42e with identifier: JS18374 to the API
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_3b5e305709e47a954f96421fced13686.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.0L',
 'engine_horse_power': 55,
 'expiration_date': '2026-03-28T16:59:26Z',
 'fuel_type': 'petrol',
 'id': '0b538691-ff5a-59fd-bbdf-8e023a42c42e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS18374',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 71806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b538691-ff5a-59fd-bbdf-8e023a42c42e/0b538691-ff5a-59fd-bbdf-8e023a42c42e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_ac5cb0924974caff1f3a6a043ceb91f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b538691-ff5a-59fd-bbdf-8e023a42c42e/0b538691-ff5a-59fd-bbdf-8e023a42c42e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_1db0a4a7a1923dbef6099fd21d444096.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b538691-ff5a-59fd-bbdf-8e023a42c42e/0b538691-ff5a-59fd-bbdf-8e023a42c42e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_6a1788ee14c53c98fc2a99e45ee8d4f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b538691-ff5a-59fd-bbdf-8e023a42c42e/0b538691-ff5a-59fd-bbdf-8e023a42c42e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_8dfb1bd7468a9dd9839ddeb3d85bf29a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b538691-ff5a-59fd-bbdf-8e023a42c42e/0b538691-ff5a-59fd-bbdf-8e023a42c42e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_5a760ce5983d6932cfee816ce9c207d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b538691-ff5a-59fd-bbdf-8e023a42c42e/0b538691-ff5a-59fd-bbdf-8e023a42c42e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/d4/26d4ffdf038e28b723a631cfb55c9535/pa/JS18374_3b5e305709e47a954f96421fced13686.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1999-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 1999}
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-27 11:32:15 [auto1.be] INFO: Saving data for JS18374: {'created_time': 1774611135.66766, 'last_price_update_time': 1774611135.66767, 'auction_closing_time': 1774717166.0}
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS18374') HTTP/1.1" 204 0
2026-03-27 11:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:16 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:16 [auto1.be] INFO: Found listing with ID: AN55129
2026-03-27 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN55129%27 HTTP/1.1" 200 None
2026-03-27 11:32:16 [auto1.be] INFO: Scrape type for AN55129: 0
2026-03-27 11:32:16 [auto1.be] INFO: Found listing with ID: UT50756
2026-03-27 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT50756%27 HTTP/1.1" 200 None
2026-03-27 11:32:16 [auto1.be] INFO: Scrape type for UT50756: 2
2026-03-27 11:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e87afb1-d099-5181-be94-b578298e7d77 with identifier: UT50756
2026-03-27 11:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e87afb1-d099-5181-be94-b578298e7d77 with scrape type 2
2026-03-27 11:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e87afb1-d099-5181-be94-b578298e7d77 with scrape type 2
2026-03-27 11:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e87afb1-d099-5181-be94-b578298e7d77, identifier: UT50756
2026-03-27 11:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e87afb1-d099-5181-be94-b578298e7d77 with identifier: UT50756
2026-03-27 11:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e87afb1-d099-5181-be94-b578298e7d77 with identifier: UT50756
2026-03-27 11:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e87afb1-d099-5181-be94-b578298e7d77 with identifier: UT50756 to the API
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-27T16:34:33Z',
 'fuel_type': 'diesel',
 'id': '4e87afb1-d099-5181-be94-b578298e7d77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT50756',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 203920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT50756%27 HTTP/1.1" 200 None
2026-03-27 11:32:17 [auto1.be] INFO: Saving data for UT50756: {'auction_closing_time': 1774629273.0, 'created_time': 1774427447.66123, 'last_price_update_time': 1774611137.252313}
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UT50756') HTTP/1.1" 204 0
2026-03-27 11:32:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:17 [auto1.be] INFO: Found listing with ID: WE24792
2026-03-27 11:32:17 [auto1.be] INFO: Found listing with ID: AK37394
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK37394%27 HTTP/1.1" 200 None
2026-03-27 11:32:17 [auto1.be] INFO: Scrape type for AK37394: 0
2026-03-27 11:32:17 [auto1.be] INFO: Found listing with ID: GE39659
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE39659%27 HTTP/1.1" 200 None
2026-03-27 11:32:17 [auto1.be] INFO: Scrape type for GE39659: 0
2026-03-27 11:32:17 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-27 11:32:17 [auto1.be] INFO: Scrape type for VM79296: 0
2026-03-27 11:32:17 [auto1.be] INFO: Found listing with ID: KV70453
2026-03-27 11:32:17 [auto1.be] INFO: Found listing with ID: WC44537
2026-03-27 11:32:17 [auto1.be] INFO: Found listing with ID: ZU65660
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU65660%27 HTTP/1.1" 200 None
2026-03-27 11:32:17 [auto1.be] INFO: Scrape type for ZU65660: 0
2026-03-27 11:32:17 [auto1.be] INFO: Found listing with ID: PM94019
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM94019%27 HTTP/1.1" 200 None
2026-03-27 11:32:17 [auto1.be] INFO: Scrape type for PM94019: 0
2026-03-27 11:32:17 [auto1.be] INFO: Found listing with ID: ZB89914
2026-03-27 11:32:17 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-27 11:32:17 [auto1.be] INFO: Scrape type for GT11330: 2
2026-03-27 11:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bad3d40-207e-5f55-b53a-295eede7508c with identifier: GT11330
2026-03-27 11:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bad3d40-207e-5f55-b53a-295eede7508c with scrape type 2
2026-03-27 11:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bad3d40-207e-5f55-b53a-295eede7508c with scrape type 2
2026-03-27 11:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0bad3d40-207e-5f55-b53a-295eede7508c, identifier: GT11330
2026-03-27 11:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0bad3d40-207e-5f55-b53a-295eede7508c with identifier: GT11330
2026-03-27 11:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0bad3d40-207e-5f55-b53a-295eede7508c with identifier: GT11330
2026-03-27 11:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0bad3d40-207e-5f55-b53a-295eede7508c with identifier: GT11330 to the API
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:05:24Z',
 'fuel_type': 'petrol',
 'id': '0bad3d40-207e-5f55-b53a-295eede7508c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT11330',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 128631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-03',
 'seller_name': None,
 'title': 'Smart forfour 1.5 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2004}
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-27 11:32:17 [auto1.be] INFO: Saving data for GT11330: {'auction_closing_time': 1774627524.0, 'created_time': 1773226265.57557, 'last_price_update_time': 1774611137.951307}
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GT11330') HTTP/1.1" 204 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: FR59063
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: NK19061
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: BM85985
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BM85985%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for BM85985: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: MU91514
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: FD33487
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: WC52541
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: LK09797
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK09797%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for LK09797: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: JE64072
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE64072%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for JE64072: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: SD53912
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD53912%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for SD53912: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: CW76300
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW76300%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for CW76300: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: HJ12403
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ12403%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for HJ12403: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: HB52812
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB52812%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for HB52812: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: SP07313
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP07313%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for SP07313: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: JB68456
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: MR16317
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: UA02413
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: AY21954
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: DK19307
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK19307%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for DK19307: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA19213%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for FA19213: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: GX65351
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX65351%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for GX65351: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: UZ05678
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ05678%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for UZ05678: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: BY14138
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: JC10329
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: KL87992
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL87992%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for KL87992: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: EJ24025
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ24025%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for EJ24025: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: NS20906
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS20906%27 HTTP/1.1" 200 None
2026-03-27 11:32:18 [auto1.be] INFO: Scrape type for NS20906: 0
2026-03-27 11:32:18 [auto1.be] INFO: Found listing with ID: BB18190
2026-03-27 11:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:19 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS28625%27 HTTP/1.1" 200 None
2026-03-27 11:32:19 [auto1.be] INFO: Scrape type for PS28625: 0
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: ZW31488
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: SW05863
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW05863%27 HTTP/1.1" 200 None
2026-03-27 11:32:19 [auto1.be] INFO: Scrape type for SW05863: 0
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: GU40914
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GU40914%27 HTTP/1.1" 200 None
2026-03-27 11:32:19 [auto1.be] INFO: Scrape type for GU40914: 0
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: ZG29965
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: WW09549
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW09549%27 HTTP/1.1" 200 None
2026-03-27 11:32:19 [auto1.be] INFO: Scrape type for WW09549: 0
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: TE01845
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE01845%27 HTTP/1.1" 200 None
2026-03-27 11:32:19 [auto1.be] INFO: Scrape type for TE01845: 0
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: SM05955
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM05955%27 HTTP/1.1" 200 None
2026-03-27 11:32:19 [auto1.be] INFO: Scrape type for SM05955: 0
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: UJ88717
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ88717%27 HTTP/1.1" 200 None
2026-03-27 11:32:19 [auto1.be] INFO: Scrape type for UJ88717: 0
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: FH77078
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: LA53308
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: ER20573
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: GS05336
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: SM94010
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM94010%27 HTTP/1.1" 200 None
2026-03-27 11:32:19 [auto1.be] INFO: Scrape type for SM94010: 2
2026-03-27 11:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9b9b1fd-fabf-5560-a042-bdc846f8eb2e with identifier: SM94010
2026-03-27 11:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9b9b1fd-fabf-5560-a042-bdc846f8eb2e with scrape type 2
2026-03-27 11:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9b9b1fd-fabf-5560-a042-bdc846f8eb2e with scrape type 2
2026-03-27 11:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9b9b1fd-fabf-5560-a042-bdc846f8eb2e, identifier: SM94010
2026-03-27 11:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9b9b1fd-fabf-5560-a042-bdc846f8eb2e with identifier: SM94010
2026-03-27 11:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9b9b1fd-fabf-5560-a042-bdc846f8eb2e with identifier: SM94010
2026-03-27 11:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9b9b1fd-fabf-5560-a042-bdc846f8eb2e with identifier: SM94010 to the API
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:07:04Z',
 'fuel_type': 'petrol',
 'id': 'f9b9b1fd-fabf-5560-a042-bdc846f8eb2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM94010',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 67162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-21',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2020}
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM94010%27 HTTP/1.1" 200 None
2026-03-27 11:32:19 [auto1.be] INFO: Saving data for SM94010: {'auction_closing_time': 1774627624.0, 'created_time': 1773834010.334054, 'last_price_update_time': 1774611139.740793}
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SM94010') HTTP/1.1" 204 0
2026-03-27 11:32:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:19 [auto1.be] INFO: Found listing with ID: VF97683
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF97683%27 HTTP/1.1" 200 None
2026-03-27 11:32:19 [auto1.be] INFO: Scrape type for VF97683: 2
2026-03-27 11:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a50beac-bb9c-55f0-ad23-90c8845aa46d with identifier: VF97683
2026-03-27 11:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a50beac-bb9c-55f0-ad23-90c8845aa46d with scrape type 2
2026-03-27 11:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a50beac-bb9c-55f0-ad23-90c8845aa46d with scrape type 2
2026-03-27 11:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a50beac-bb9c-55f0-ad23-90c8845aa46d, identifier: VF97683
2026-03-27 11:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a50beac-bb9c-55f0-ad23-90c8845aa46d with identifier: VF97683
2026-03-27 11:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a50beac-bb9c-55f0-ad23-90c8845aa46d with identifier: VF97683
2026-03-27 11:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a50beac-bb9c-55f0-ad23-90c8845aa46d with identifier: VF97683 to the API
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:21:14Z',
 'fuel_type': 'petrol',
 'id': '0a50beac-bb9c-55f0-ad23-90c8845aa46d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF97683',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 175257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-29',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.5 TSI ACT sport',
 'transmission': 'automatic',
 'trim': 'sport',
 'year': 2018}
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF97683%27 HTTP/1.1" 200 None
2026-03-27 11:32:20 [auto1.be] INFO: Saving data for VF97683: {'auction_closing_time': 1774628474.0, 'created_time': 1773233634.059029, 'last_price_update_time': 1774611140.312956}
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VF97683') HTTP/1.1" 204 0
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: TY50069
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY50069%27 HTTP/1.1" 200 None
2026-03-27 11:32:20 [auto1.be] INFO: Scrape type for TY50069: 0
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: JC36260
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: SW67085
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: CS11712
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS11712%27 HTTP/1.1" 200 None
2026-03-27 11:32:20 [auto1.be] INFO: Scrape type for CS11712: 2
2026-03-27 11:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b807b8c4-c175-5b73-866c-5b88f8f2389e with identifier: CS11712
2026-03-27 11:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b807b8c4-c175-5b73-866c-5b88f8f2389e with scrape type 2
2026-03-27 11:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b807b8c4-c175-5b73-866c-5b88f8f2389e with scrape type 2
2026-03-27 11:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b807b8c4-c175-5b73-866c-5b88f8f2389e, identifier: CS11712
2026-03-27 11:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b807b8c4-c175-5b73-866c-5b88f8f2389e with identifier: CS11712
2026-03-27 11:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b807b8c4-c175-5b73-866c-5b88f8f2389e with identifier: CS11712
2026-03-27 11:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b807b8c4-c175-5b73-866c-5b88f8f2389e with identifier: CS11712 to the API
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 295,
 'expiration_date': '2026-03-27T16:57:48Z',
 'fuel_type': 'petrol',
 'id': 'b807b8c4-c175-5b73-866c-5b88f8f2389e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS11712',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XJS',
 'odometer': 124271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1984-03-01',
 'seller_name': None,
 'title': 'Jaguar XJS 5.3 HE V12',
 'transmission': 'automatic',
 'trim': '',
 'year': 1984}
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS11712%27 HTTP/1.1" 200 None
2026-03-27 11:32:20 [auto1.be] INFO: Saving data for CS11712: {'auction_closing_time': 1774630668.0, 'created_time': 1774006267.300189, 'last_price_update_time': 1774611140.795477}
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS11712') HTTP/1.1" 204 0
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: WN81637
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN81637%27 HTTP/1.1" 200 None
2026-03-27 11:32:20 [auto1.be] INFO: Scrape type for WN81637: 0
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: PX40463
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: PC57264
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: GW94232
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: HX20099
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: VV09395
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV09395%27 HTTP/1.1" 200 None
2026-03-27 11:32:20 [auto1.be] INFO: Scrape type for VV09395: 0
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: VF99667
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: UK54549
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK54549%27 HTTP/1.1" 200 None
2026-03-27 11:32:20 [auto1.be] INFO: Scrape type for UK54549: 0
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: GV19047
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: TU34385
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: TV74985
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: YV88346
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: YJ60712
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ60712%27 HTTP/1.1" 200 None
2026-03-27 11:32:20 [auto1.be] INFO: Scrape type for YJ60712: 0
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: DN97362
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN97362%27 HTTP/1.1" 200 None
2026-03-27 11:32:20 [auto1.be] INFO: Scrape type for DN97362: 0
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: ZL06267
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: YG56736
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG56736%27 HTTP/1.1" 200 None
2026-03-27 11:32:20 [auto1.be] INFO: Scrape type for YG56736: 0
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: SY66485
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: BP07679
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP07679%27 HTTP/1.1" 200 None
2026-03-27 11:32:20 [auto1.be] INFO: Scrape type for BP07679: 0
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: BF62281
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV48703%27 HTTP/1.1" 200 None
2026-03-27 11:32:20 [auto1.be] INFO: Scrape type for BV48703: 0
2026-03-27 11:32:20 [auto1.be] INFO: Found listing with ID: KB97788
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB97788%27 HTTP/1.1" 200 None
2026-03-27 11:32:20 [auto1.be] INFO: Scrape type for KB97788: 0
2026-03-27 11:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:21 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: NG88652
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: NA06966
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA06966%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for NA06966: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: GT94286
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT94286%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for GT94286: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: EJ45818
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: KN95173
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: PD86825
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD86825%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for PD86825: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: GF08223
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF08223%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for GF08223: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: DV17343
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV17343%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for DV17343: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: WM08929
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: JS73034
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS73034%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for JS73034: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: YT32730
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: EW15298
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW15298%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for EW15298: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: BX57977
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: TD21641
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: MN64395
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN64395%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for MN64395: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: YF72267
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF72267%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for YF72267: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: HA21720
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA21720%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for HA21720: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: CP38880
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: GC12715
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC12715%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for GC12715: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: CM84759
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM84759%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for CM84759: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: DN62298
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN62298%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for DN62298: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: HX60509
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX60509%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for HX60509: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: ZW91403
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW91403%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for ZW91403: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: RK04043
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK04043%27 HTTP/1.1" 200 None
2026-03-27 11:32:21 [auto1.be] INFO: Scrape type for RK04043: 0
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: HN48415
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: JL24574
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: HA16035
2026-03-27 11:32:21 [auto1.be] INFO: Found listing with ID: KZ62896
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ62896%27 HTTP/1.1" 200 None
2026-03-27 11:32:22 [auto1.be] INFO: Scrape type for KZ62896: 2
2026-03-27 11:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fda5f4e-cac1-50aa-b990-82632f940691 with identifier: KZ62896
2026-03-27 11:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fda5f4e-cac1-50aa-b990-82632f940691 with scrape type 2
2026-03-27 11:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fda5f4e-cac1-50aa-b990-82632f940691 with scrape type 2
2026-03-27 11:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8fda5f4e-cac1-50aa-b990-82632f940691, identifier: KZ62896
2026-03-27 11:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8fda5f4e-cac1-50aa-b990-82632f940691 with identifier: KZ62896
2026-03-27 11:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8fda5f4e-cac1-50aa-b990-82632f940691 with identifier: KZ62896
2026-03-27 11:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8fda5f4e-cac1-50aa-b990-82632f940691 with identifier: KZ62896 to the API
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-27T16:38:32Z',
 'fuel_type': 'diesel',
 'id': '8fda5f4e-cac1-50aa-b990-82632f940691',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ62896',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 156771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 2.0 TD Sd4 SD4 HSE',
 'transmission': 'automatic',
 'trim': 'SD4 HSE',
 'year': 2019}
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ62896%27 HTTP/1.1" 200 None
2026-03-27 11:32:22 [auto1.be] INFO: Saving data for KZ62896: {'auction_closing_time': 1774629512.0, 'created_time': 1773693581.976136, 'last_price_update_time': 1774611142.419177}
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KZ62896') HTTP/1.1" 204 0
2026-03-27 11:32:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:22 [auto1.be] INFO: Found listing with ID: LS47713
2026-03-27 11:32:22 [auto1.be] INFO: Found listing with ID: HB25779
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB25779%27 HTTP/1.1" 200 None
2026-03-27 11:32:22 [auto1.be] INFO: Scrape type for HB25779: 0
2026-03-27 11:32:22 [auto1.be] INFO: Found listing with ID: EF75882
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF75882%27 HTTP/1.1" 200 None
2026-03-27 11:32:22 [auto1.be] INFO: Scrape type for EF75882: 0
2026-03-27 11:32:22 [auto1.be] INFO: Found listing with ID: WG25655
2026-03-27 11:32:22 [auto1.be] INFO: Found listing with ID: NA16602
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA16602%27 HTTP/1.1" 200 None
2026-03-27 11:32:22 [auto1.be] INFO: Scrape type for NA16602: 0
2026-03-27 11:32:22 [auto1.be] INFO: Found listing with ID: JE01185
2026-03-27 11:32:22 [auto1.be] INFO: Found listing with ID: WP12382
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP12382%27 HTTP/1.1" 200 None
2026-03-27 11:32:22 [auto1.be] INFO: Scrape type for WP12382: 0
2026-03-27 11:32:22 [auto1.be] INFO: Found listing with ID: KS84566
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS84566%27 HTTP/1.1" 200 None
2026-03-27 11:32:22 [auto1.be] INFO: Scrape type for KS84566: 0
2026-03-27 11:32:22 [auto1.be] INFO: Found listing with ID: PX88472
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PX88472%27 HTTP/1.1" 200 None
2026-03-27 11:32:22 [auto1.be] INFO: Scrape type for PX88472: 0
2026-03-27 11:32:22 [auto1.be] INFO: Found listing with ID: HM70865
2026-03-27 11:32:22 [auto1.be] INFO: Found listing with ID: WN70923
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN70923%27 HTTP/1.1" 200 None
2026-03-27 11:32:22 [auto1.be] INFO: Scrape type for WN70923: 0
2026-03-27 11:32:22 [auto1.be] INFO: Found listing with ID: MG56126
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG56126%27 HTTP/1.1" 200 None
2026-03-27 11:32:22 [auto1.be] INFO: Scrape type for MG56126: 0
2026-03-27 11:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:23 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:23 [auto1.be] INFO: Found listing with ID: LE21271
2026-03-27 11:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE21271%27 HTTP/1.1" 200 None
2026-03-27 11:32:23 [auto1.be] INFO: Scrape type for LE21271: 0
2026-03-27 11:32:23 [auto1.be] INFO: Found listing with ID: UD60313
2026-03-27 11:32:23 [auto1.be] INFO: Found listing with ID: UE64261
2026-03-27 11:32:23 [auto1.be] INFO: Found listing with ID: VJ74010
2026-03-27 11:32:23 [auto1.be] INFO: Found listing with ID: MG36975
2026-03-27 11:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG36975%27 HTTP/1.1" 200 None
2026-03-27 11:32:23 [auto1.be] INFO: Scrape type for MG36975: 0
2026-03-27 11:32:23 [auto1.be] INFO: Found listing with ID: DV87479
2026-03-27 11:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV87479%27 HTTP/1.1" 200 None
2026-03-27 11:32:23 [auto1.be] INFO: Scrape type for DV87479: 0
2026-03-27 11:32:23 [auto1.be] INFO: Found listing with ID: RS16246
2026-03-27 11:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16246%27 HTTP/1.1" 200 None
2026-03-27 11:32:23 [auto1.be] INFO: Scrape type for RS16246: 2
2026-03-27 11:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da500fd4-4a0f-5ed9-b034-125be11967b8 with identifier: RS16246
2026-03-27 11:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da500fd4-4a0f-5ed9-b034-125be11967b8 with scrape type 2
2026-03-27 11:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da500fd4-4a0f-5ed9-b034-125be11967b8 with scrape type 2
2026-03-27 11:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: da500fd4-4a0f-5ed9-b034-125be11967b8, identifier: RS16246
2026-03-27 11:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: da500fd4-4a0f-5ed9-b034-125be11967b8 with identifier: RS16246
2026-03-27 11:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: da500fd4-4a0f-5ed9-b034-125be11967b8 with identifier: RS16246
2026-03-27 11:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: da500fd4-4a0f-5ed9-b034-125be11967b8 with identifier: RS16246 to the API
2026-03-27 11:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-27T16:08:44Z',
 'fuel_type': 'diesel',
 'id': 'da500fd4-4a0f-5ed9-b034-125be11967b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS16246',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 250274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-20',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16246%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Saving data for RS16246: {'auction_closing_time': 1774627724.0, 'created_time': 1774427445.556939, 'last_price_update_time': 1774611144.085019}
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RS16246') HTTP/1.1" 204 0
2026-03-27 11:32:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: BT30739
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT30739%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for BT30739: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: TY33491
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: JM03834
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM03834%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for JM03834: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: RB51541
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB51541%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for RB51541: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: NR75863
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: ZZ58994
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ58994%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for ZZ58994: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: HB75588
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: RG16696
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG16696%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for RG16696: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: GF87206
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: UU36323
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU36323%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for UU36323: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: EZ92638
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: ZY78390
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: XJ77017
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ77017%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for XJ77017: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: PN24466
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: WP70532
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: HY85639
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: ET07668
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: UT96766
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: GL72851
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: CY81530
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY81530%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for CY81530: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: WF34638
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF34638%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for WF34638: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: GF79984
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF79984%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for GF79984: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: GH08369
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH08369%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for GH08369: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: RS06619
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: BA04765
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for SB67636: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD01441%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for KD01441: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: EU62289
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: CK78813
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: DU82923
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU82923%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for DU82923: 0
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: XE32129
2026-03-27 11:32:24 [auto1.be] INFO: Found listing with ID: UT85674
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT85674%27 HTTP/1.1" 200 None
2026-03-27 11:32:24 [auto1.be] INFO: Scrape type for UT85674: 0
2026-03-27 11:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:25 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: FT17632
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT17632%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for FT17632: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: KE03465
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: PB50741
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB50741%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for PB50741: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: JU70188
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: NZ71290
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: ET32561
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET32561%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for ET32561: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: RP50395
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: FY96081
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY96081%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for FY96081: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: VZ37622
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ37622%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for VZ37622: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: XU08826
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: CB57627
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB57627%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for CB57627: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: RX78624
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX78624%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for RX78624: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: UG87169
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: BW40259
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW40259%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for BW40259: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: CP28232
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP28232%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for CP28232: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: WF35410
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: NG85298
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG85298%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for NG85298: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: SR96729
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR96729%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for SR96729: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: FK63075
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: YN70818
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: JY55711
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY55711%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for JY55711: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: NX07614
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NX07614%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for NX07614: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: DZ60295
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: JV06807
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV06807%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for JV06807: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: XP06232
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP06232%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for XP06232: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: HV83812
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HV83812%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for HV83812: 0
2026-03-27 11:32:25 [auto1.be] INFO: Found listing with ID: TD99955
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD99955%27 HTTP/1.1" 200 None
2026-03-27 11:32:25 [auto1.be] INFO: Scrape type for TD99955: 2
2026-03-27 11:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e8adc50-78ed-56b6-a9f1-630e151ae43c with identifier: TD99955
2026-03-27 11:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e8adc50-78ed-56b6-a9f1-630e151ae43c with scrape type 2
2026-03-27 11:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e8adc50-78ed-56b6-a9f1-630e151ae43c with scrape type 2
2026-03-27 11:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e8adc50-78ed-56b6-a9f1-630e151ae43c, identifier: TD99955
2026-03-27 11:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e8adc50-78ed-56b6-a9f1-630e151ae43c with identifier: TD99955
2026-03-27 11:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e8adc50-78ed-56b6-a9f1-630e151ae43c with identifier: TD99955
2026-03-27 11:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e8adc50-78ed-56b6-a9f1-630e151ae43c with identifier: TD99955 to the API
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-27T16:42:46Z',
 'fuel_type': 'diesel',
 'id': '4e8adc50-78ed-56b6-a9f1-630e151ae43c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD99955',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 193745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-17',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI lang BlueEfficiency Ambiente',
 'transmission': 'automatic',
 'trim': 'lang BlueEfficiency Ambiente',
 'year': 2011}
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD99955%27 HTTP/1.1" 200 None
2026-03-27 11:32:26 [auto1.be] INFO: Saving data for TD99955: {'auction_closing_time': 1774629766.0, 'created_time': 1774427450.235532, 'last_price_update_time': 1774611146.251808}
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TD99955') HTTP/1.1" 204 0
2026-03-27 11:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:26 [auto1.be] INFO: Found listing with ID: CU54965
2026-03-27 11:32:26 [auto1.be] INFO: Found listing with ID: DZ47511
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ47511%27 HTTP/1.1" 200 None
2026-03-27 11:32:26 [auto1.be] INFO: Scrape type for DZ47511: 2
2026-03-27 11:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f364d224-0986-56a0-8ff0-2d63ec46af41 with identifier: DZ47511
2026-03-27 11:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f364d224-0986-56a0-8ff0-2d63ec46af41 with scrape type 2
2026-03-27 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f364d224-0986-56a0-8ff0-2d63ec46af41 with scrape type 2
2026-03-27 11:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f364d224-0986-56a0-8ff0-2d63ec46af41, identifier: DZ47511
2026-03-27 11:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f364d224-0986-56a0-8ff0-2d63ec46af41 with identifier: DZ47511
2026-03-27 11:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f364d224-0986-56a0-8ff0-2d63ec46af41 with identifier: DZ47511
2026-03-27 11:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f364d224-0986-56a0-8ff0-2d63ec46af41 with identifier: DZ47511 to the API
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-27T16:01:51Z',
 'fuel_type': 'diesel',
 'id': 'f364d224-0986-56a0-8ff0-2d63ec46af41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ47511',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 244059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-15',
 'seller_name': None,
 'title': 'Porsche Cayenne Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ47511%27 HTTP/1.1" 200 None
2026-03-27 11:32:26 [auto1.be] INFO: Saving data for DZ47511: {'auction_closing_time': 1774627311.0, 'created_time': 1773132052.956766, 'last_price_update_time': 1774611146.826037}
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ47511') HTTP/1.1" 204 0
2026-03-27 11:32:26 [auto1.be] INFO: Found listing with ID: VP78052
2026-03-27 11:32:26 [auto1.be] INFO: Found listing with ID: LU57282
2026-03-27 11:32:26 [auto1.be] INFO: Found listing with ID: RR45752
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR45752%27 HTTP/1.1" 200 None
2026-03-27 11:32:26 [auto1.be] INFO: Scrape type for RR45752: 0
2026-03-27 11:32:26 [auto1.be] INFO: Found listing with ID: SN11216
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN11216%27 HTTP/1.1" 200 None
2026-03-27 11:32:26 [auto1.be] INFO: Scrape type for SN11216: 0
2026-03-27 11:32:26 [auto1.be] INFO: Found listing with ID: JZ23244
2026-03-27 11:32:26 [auto1.be] INFO: Found listing with ID: PH43501
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH43501%27 HTTP/1.1" 200 None
2026-03-27 11:32:26 [auto1.be] INFO: Scrape type for PH43501: 2
2026-03-27 11:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bca697c-b3f7-596b-b836-42f41848bc8d with identifier: PH43501
2026-03-27 11:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bca697c-b3f7-596b-b836-42f41848bc8d with scrape type 2
2026-03-27 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bca697c-b3f7-596b-b836-42f41848bc8d with scrape type 2
2026-03-27 11:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9bca697c-b3f7-596b-b836-42f41848bc8d, identifier: PH43501
2026-03-27 11:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9bca697c-b3f7-596b-b836-42f41848bc8d with identifier: PH43501
2026-03-27 11:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9bca697c-b3f7-596b-b836-42f41848bc8d with identifier: PH43501
2026-03-27 11:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9bca697c-b3f7-596b-b836-42f41848bc8d with identifier: PH43501 to the API
2026-03-27 11:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-27T16:50:19Z',
 'fuel_type': 'hybrid',
 'id': '9bca697c-b3f7-596b-b836-42f41848bc8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH43501',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 55616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-01',
 'seller_name': None,
 'title': 'BMW X2 xDrive 25e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-27 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH43501%27 HTTP/1.1" 200 None
2026-03-27 11:32:27 [auto1.be] INFO: Saving data for PH43501: {'auction_closing_time': 1774630219.0, 'created_time': 1774427459.041371, 'last_price_update_time': 1774611147.308097}
2026-03-27 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PH43501') HTTP/1.1" 204 0
2026-03-27 11:32:27 [auto1.be] INFO: Found listing with ID: LH22912
2026-03-27 11:32:27 [auto1.be] INFO: Found listing with ID: PV92742
2026-03-27 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV92742%27 HTTP/1.1" 200 None
2026-03-27 11:32:27 [auto1.be] INFO: Scrape type for PV92742: 0
2026-03-27 11:32:27 [auto1.be] INFO: Found listing with ID: VA33798
2026-03-27 11:32:27 [auto1.be] INFO: Found listing with ID: SH58786
2026-03-27 11:32:27 [auto1.be] INFO: Found listing with ID: JR78742
2026-03-27 11:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:28 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: RL53364
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: PR99089
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR99089%27 HTTP/1.1" 200 None
2026-03-27 11:32:28 [auto1.be] INFO: Scrape type for PR99089: 0
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: HL56406
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: KY60433
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: RS25699
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS25699%27 HTTP/1.1" 200 None
2026-03-27 11:32:28 [auto1.be] INFO: Scrape type for RS25699: 0
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: SU77944
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-27 11:32:28 [auto1.be] INFO: Scrape type for PY81659: 0
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: SF71038
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF71038%27 HTTP/1.1" 200 None
2026-03-27 11:32:28 [auto1.be] INFO: Scrape type for SF71038: 0
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: FF97122
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: HL05710
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: LD17211
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD17211%27 HTTP/1.1" 200 None
2026-03-27 11:32:28 [auto1.be] INFO: Scrape type for LD17211: 0
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: CH75684
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH75684%27 HTTP/1.1" 200 None
2026-03-27 11:32:28 [auto1.be] INFO: Scrape type for CH75684: 0
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: JZ19125
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ19125%27 HTTP/1.1" 200 None
2026-03-27 11:32:28 [auto1.be] INFO: Scrape type for JZ19125: 0
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ61714%27 HTTP/1.1" 200 None
2026-03-27 11:32:28 [auto1.be] INFO: Scrape type for HJ61714: 0
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: YK68229
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: KM06752
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: CW56450
2026-03-27 11:32:28 [auto1.be] INFO: Found listing with ID: HK96372
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK96372%27 HTTP/1.1" 200 None
2026-03-27 11:32:28 [auto1.be] INFO: Scrape type for HK96372: 2
2026-03-27 11:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77d96d05-1234-5da7-9d83-335147965aef with identifier: HK96372
2026-03-27 11:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77d96d05-1234-5da7-9d83-335147965aef with scrape type 2
2026-03-27 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77d96d05-1234-5da7-9d83-335147965aef with scrape type 2
2026-03-27 11:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 77d96d05-1234-5da7-9d83-335147965aef, identifier: HK96372
2026-03-27 11:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 77d96d05-1234-5da7-9d83-335147965aef with identifier: HK96372
2026-03-27 11:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 77d96d05-1234-5da7-9d83-335147965aef with identifier: HK96372
2026-03-27 11:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 77d96d05-1234-5da7-9d83-335147965aef with identifier: HK96372 to the API
2026-03-27 11:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:22:37Z',
 'fuel_type': 'diesel',
 'id': '77d96d05-1234-5da7-9d83-335147965aef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK96372',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 196988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK96372%27 HTTP/1.1" 200 None
2026-03-27 11:32:29 [auto1.be] INFO: Saving data for HK96372: {'auction_closing_time': 1774628557.0, 'created_time': 1773134384.780723, 'last_price_update_time': 1774611149.168262}
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HK96372') HTTP/1.1" 204 0
2026-03-27 11:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: PD31186
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD31186%27 HTTP/1.1" 200 None
2026-03-27 11:32:29 [auto1.be] INFO: Scrape type for PD31186: 0
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: RU12474
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: AW18524
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW18524%27 HTTP/1.1" 200 None
2026-03-27 11:32:29 [auto1.be] INFO: Scrape type for AW18524: 0
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: UD69238
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD69238%27 HTTP/1.1" 200 None
2026-03-27 11:32:29 [auto1.be] INFO: Scrape type for UD69238: 0
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: GM68139
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: EK14567
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: VL13165
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: KD31159
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31159%27 HTTP/1.1" 200 None
2026-03-27 11:32:29 [auto1.be] INFO: Scrape type for KD31159: 0
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: HL89741
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: HP19599
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP19599%27 HTTP/1.1" 200 None
2026-03-27 11:32:29 [auto1.be] INFO: Scrape type for HP19599: 0
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: HN90947
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN90947%27 HTTP/1.1" 200 None
2026-03-27 11:32:29 [auto1.be] INFO: Scrape type for HN90947: 0
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: TR57009
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: GV15800
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV15800%27 HTTP/1.1" 200 None
2026-03-27 11:32:29 [auto1.be] INFO: Scrape type for GV15800: 0
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: BX24259
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX24259%27 HTTP/1.1" 200 None
2026-03-27 11:32:29 [auto1.be] INFO: Scrape type for BX24259: 0
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: LM46690
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: XT89751
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT89751%27 HTTP/1.1" 200 None
2026-03-27 11:32:29 [auto1.be] INFO: Scrape type for XT89751: 0
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-27 11:32:29 [auto1.be] INFO: Scrape type for UA82763: 0
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: LH74784
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH74784%27 HTTP/1.1" 200 None
2026-03-27 11:32:29 [auto1.be] INFO: Scrape type for LH74784: 0
2026-03-27 11:32:29 [auto1.be] INFO: Found listing with ID: LB84163
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB84163%27 HTTP/1.1" 200 None
2026-03-27 11:32:29 [auto1.be] INFO: Scrape type for LB84163: 0
2026-03-27 11:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:30 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: MR50383
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR50383%27 HTTP/1.1" 200 None
2026-03-27 11:32:30 [auto1.be] INFO: Scrape type for MR50383: 0
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: JF01400
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: TR88361
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR88361%27 HTTP/1.1" 200 None
2026-03-27 11:32:30 [auto1.be] INFO: Scrape type for TR88361: 0
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: XN17916
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN17916%27 HTTP/1.1" 200 None
2026-03-27 11:32:30 [auto1.be] INFO: Scrape type for XN17916: 0
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: ZP16804
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP16804%27 HTTP/1.1" 200 None
2026-03-27 11:32:30 [auto1.be] INFO: Scrape type for ZP16804: 0
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: VD34394
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: BV48313
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: JS61863
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS61863%27 HTTP/1.1" 200 None
2026-03-27 11:32:30 [auto1.be] INFO: Scrape type for JS61863: 0
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: NN37079
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: HP20336
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: NH80895
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: GV95180
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV95180%27 HTTP/1.1" 200 None
2026-03-27 11:32:30 [auto1.be] INFO: Scrape type for GV95180: 0
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: AH50930
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AH50930%27 HTTP/1.1" 200 None
2026-03-27 11:32:30 [auto1.be] INFO: Scrape type for AH50930: 0
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: UY55181
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: JA16064
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA16064%27 HTTP/1.1" 200 None
2026-03-27 11:32:30 [auto1.be] INFO: Scrape type for JA16064: 0
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: KE76043
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE76043%27 HTTP/1.1" 200 None
2026-03-27 11:32:30 [auto1.be] INFO: Scrape type for KE76043: 0
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: WR26976
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR26976%27 HTTP/1.1" 200 None
2026-03-27 11:32:30 [auto1.be] INFO: Scrape type for WR26976: 0
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: BF20284
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF20284%27 HTTP/1.1" 200 None
2026-03-27 11:32:30 [auto1.be] INFO: Scrape type for BF20284: 0
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: JX10335
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: EM39704
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM39704%27 HTTP/1.1" 200 None
2026-03-27 11:32:30 [auto1.be] INFO: Scrape type for EM39704: 0
2026-03-27 11:32:30 [auto1.be] INFO: Found listing with ID: PT71351
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT71351%27 HTTP/1.1" 200 None
2026-03-27 11:32:30 [auto1.be] INFO: Scrape type for PT71351: 2
2026-03-27 11:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df42b96d-b084-5802-a1d6-aa1f91170537 with identifier: PT71351
2026-03-27 11:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df42b96d-b084-5802-a1d6-aa1f91170537 with scrape type 2
2026-03-27 11:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df42b96d-b084-5802-a1d6-aa1f91170537 with scrape type 2
2026-03-27 11:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: df42b96d-b084-5802-a1d6-aa1f91170537, identifier: PT71351
2026-03-27 11:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: df42b96d-b084-5802-a1d6-aa1f91170537 with identifier: PT71351
2026-03-27 11:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: df42b96d-b084-5802-a1d6-aa1f91170537 with identifier: PT71351
2026-03-27 11:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: df42b96d-b084-5802-a1d6-aa1f91170537 with identifier: PT71351 to the API
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:41:38Z',
 'fuel_type': 'diesel',
 'id': 'df42b96d-b084-5802-a1d6-aa1f91170537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT71351',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 209959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-03',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Maxi Trendline BlueMotion Tech.',
 'transmission': 'manual',
 'trim': 'Maxi Trendline BlueMotion Tech.',
 'year': 2013}
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT71351%27 HTTP/1.1" 200 None
2026-03-27 11:32:31 [auto1.be] INFO: Saving data for PT71351: {'auction_closing_time': 1774629698.0, 'created_time': 1774427446.613051, 'last_price_update_time': 1774611151.359421}
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PT71351') HTTP/1.1" 204 0
2026-03-27 11:32:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: YL61422
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL61422%27 HTTP/1.1" 200 None
2026-03-27 11:32:31 [auto1.be] INFO: Scrape type for YL61422: 0
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: PL22892
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL22892%27 HTTP/1.1" 200 None
2026-03-27 11:32:31 [auto1.be] INFO: Scrape type for PL22892: 0
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: NV96305
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: BC73637
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC73637%27 HTTP/1.1" 200 None
2026-03-27 11:32:31 [auto1.be] INFO: Scrape type for BC73637: 0
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: YC89583
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC89583%27 HTTP/1.1" 200 None
2026-03-27 11:32:31 [auto1.be] INFO: Scrape type for YC89583: 0
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: XH13020
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH13020%27 HTTP/1.1" 200 None
2026-03-27 11:32:31 [auto1.be] INFO: Scrape type for XH13020: 0
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: MD83963
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD83963%27 HTTP/1.1" 200 None
2026-03-27 11:32:31 [auto1.be] INFO: Scrape type for MD83963: 0
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: FG51485
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG51485%27 HTTP/1.1" 200 None
2026-03-27 11:32:31 [auto1.be] INFO: Scrape type for FG51485: 0
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: CH15441
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: JJ92439
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: HA54004
2026-03-27 11:32:31 [auto1.be] INFO: Found listing with ID: MG71639
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG71639%27 HTTP/1.1" 200 None
2026-03-27 11:32:31 [auto1.be] INFO: Scrape type for MG71639: 2
2026-03-27 11:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6104cdc1-4410-5226-9d85-cb1d8d7e4579 with identifier: MG71639
2026-03-27 11:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6104cdc1-4410-5226-9d85-cb1d8d7e4579 with scrape type 2
2026-03-27 11:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6104cdc1-4410-5226-9d85-cb1d8d7e4579 with scrape type 2
2026-03-27 11:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6104cdc1-4410-5226-9d85-cb1d8d7e4579, identifier: MG71639
2026-03-27 11:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6104cdc1-4410-5226-9d85-cb1d8d7e4579 with identifier: MG71639
2026-03-27 11:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6104cdc1-4410-5226-9d85-cb1d8d7e4579 with identifier: MG71639
2026-03-27 11:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6104cdc1-4410-5226-9d85-cb1d8d7e4579 with identifier: MG71639 to the API
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:11:41Z',
 'fuel_type': 'diesel',
 'id': '6104cdc1-4410-5226-9d85-cb1d8d7e4579',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG71639',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 153962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-05',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2013}
2026-03-27 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG71639%27 HTTP/1.1" 200 None
2026-03-27 11:32:32 [auto1.be] INFO: Saving data for MG71639: {'auction_closing_time': 1774627901.0, 'created_time': 1773134083.850148, 'last_price_update_time': 1774611152.032635}
2026-03-27 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MG71639') HTTP/1.1" 204 0
2026-03-27 11:32:32 [auto1.be] INFO: Found listing with ID: EM07100
2026-03-27 11:32:32 [auto1.be] INFO: Found listing with ID: SL54877
2026-03-27 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL54877%27 HTTP/1.1" 200 None
2026-03-27 11:32:32 [auto1.be] INFO: Scrape type for SL54877: 0
2026-03-27 11:32:32 [auto1.be] INFO: Found listing with ID: UN79459
2026-03-27 11:32:32 [auto1.be] INFO: Found listing with ID: AE10158
2026-03-27 11:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:32 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:32 [auto1.be] INFO: Found listing with ID: EB43323
2026-03-27 11:32:32 [auto1.be] INFO: Found listing with ID: HZ77507
2026-03-27 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ77507%27 HTTP/1.1" 200 None
2026-03-27 11:32:32 [auto1.be] INFO: Scrape type for HZ77507: 2
2026-03-27 11:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 718f56a3-759f-5852-88c7-ad144fb0ef43 with identifier: HZ77507
2026-03-27 11:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 718f56a3-759f-5852-88c7-ad144fb0ef43 with scrape type 2
2026-03-27 11:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 718f56a3-759f-5852-88c7-ad144fb0ef43 with scrape type 2
2026-03-27 11:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 718f56a3-759f-5852-88c7-ad144fb0ef43, identifier: HZ77507
2026-03-27 11:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 718f56a3-759f-5852-88c7-ad144fb0ef43 with identifier: HZ77507
2026-03-27 11:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 718f56a3-759f-5852-88c7-ad144fb0ef43 with identifier: HZ77507
2026-03-27 11:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 718f56a3-759f-5852-88c7-ad144fb0ef43 with identifier: HZ77507 to the API
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:44:48Z',
 'fuel_type': 'petrol',
 'id': '718f56a3-759f-5852-88c7-ad144fb0ef43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ77507',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 154496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-22',
 'seller_name': None,
 'title': 'Audi A4 1.4 TFSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ77507%27 HTTP/1.1" 200 None
2026-03-27 11:32:33 [auto1.be] INFO: Saving data for HZ77507: {'auction_closing_time': 1774629888.0, 'created_time': 1773693867.210332, 'last_price_update_time': 1774611153.360663}
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HZ77507') HTTP/1.1" 204 0
2026-03-27 11:32:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: GJ15610
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ15610%27 HTTP/1.1" 200 None
2026-03-27 11:32:33 [auto1.be] INFO: Scrape type for GJ15610: 0
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: MZ25594
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV98137%27 HTTP/1.1" 200 None
2026-03-27 11:32:33 [auto1.be] INFO: Scrape type for WV98137: 0
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: GU08126
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GU08126%27 HTTP/1.1" 200 None
2026-03-27 11:32:33 [auto1.be] INFO: Scrape type for GU08126: 0
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: KP60973
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP60973%27 HTTP/1.1" 200 None
2026-03-27 11:32:33 [auto1.be] INFO: Scrape type for KP60973: 0
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: FA45415
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: WV41527
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: SL08078
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: CP72825
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP72825%27 HTTP/1.1" 200 None
2026-03-27 11:32:33 [auto1.be] INFO: Scrape type for CP72825: 0
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: RB45642
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB45642%27 HTTP/1.1" 200 None
2026-03-27 11:32:33 [auto1.be] INFO: Scrape type for RB45642: 0
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: YK02939
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK02939%27 HTTP/1.1" 200 None
2026-03-27 11:32:33 [auto1.be] INFO: Scrape type for YK02939: 0
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: GM72462
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: XY49769
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: GX90247
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: AV95380
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV95380%27 HTTP/1.1" 200 None
2026-03-27 11:32:33 [auto1.be] INFO: Scrape type for AV95380: 0
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: FL07479
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: CA12532
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA12532%27 HTTP/1.1" 200 None
2026-03-27 11:32:33 [auto1.be] INFO: Scrape type for CA12532: 0
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: NN78164
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN78164%27 HTTP/1.1" 200 None
2026-03-27 11:32:33 [auto1.be] INFO: Scrape type for NN78164: 0
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: NG69023
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: XN13667
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: AH50870
2026-03-27 11:32:33 [auto1.be] INFO: Found listing with ID: GJ44725
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ44725%27 HTTP/1.1" 200 None
2026-03-27 11:32:33 [auto1.be] INFO: Scrape type for GJ44725: 2
2026-03-27 11:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeb01846-f166-5fab-9075-c854dbb405ef with identifier: GJ44725
2026-03-27 11:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb01846-f166-5fab-9075-c854dbb405ef with scrape type 2
2026-03-27 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeb01846-f166-5fab-9075-c854dbb405ef with scrape type 2
2026-03-27 11:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aeb01846-f166-5fab-9075-c854dbb405ef, identifier: GJ44725
2026-03-27 11:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aeb01846-f166-5fab-9075-c854dbb405ef with identifier: GJ44725
2026-03-27 11:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aeb01846-f166-5fab-9075-c854dbb405ef with identifier: GJ44725
2026-03-27 11:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aeb01846-f166-5fab-9075-c854dbb405ef with identifier: GJ44725 to the API
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:39:09Z',
 'fuel_type': 'petrol',
 'id': 'aeb01846-f166-5fab-9075-c854dbb405ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ44725',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 170274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-06',
 'seller_name': None,
 'title': 'BMW 1er 116i Premiere',
 'transmission': 'manual',
 'trim': 'Premiere',
 'year': 2010}
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ44725%27 HTTP/1.1" 200 None
2026-03-27 11:32:34 [auto1.be] INFO: Saving data for GJ44725: {'auction_closing_time': 1774629549.0, 'created_time': 1774427443.246981, 'last_price_update_time': 1774611154.011043}
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GJ44725') HTTP/1.1" 204 0
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: AN14983
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: MN54564
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN54564%27 HTTP/1.1" 200 None
2026-03-27 11:32:34 [auto1.be] INFO: Scrape type for MN54564: 0
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: FW97507
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW97507%27 HTTP/1.1" 200 None
2026-03-27 11:32:34 [auto1.be] INFO: Scrape type for FW97507: 0
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: MG69856
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: PG30723
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG30723%27 HTTP/1.1" 200 None
2026-03-27 11:32:34 [auto1.be] INFO: Scrape type for PG30723: 0
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: CV18687
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: DJ92015
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: XB51767
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB51767%27 HTTP/1.1" 200 None
2026-03-27 11:32:34 [auto1.be] INFO: Scrape type for XB51767: 0
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: GA88008
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA88008%27 HTTP/1.1" 200 None
2026-03-27 11:32:34 [auto1.be] INFO: Scrape type for GA88008: 0
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: AD35856
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: KA73952
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: RL11513
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: DC36147
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM47313%27 HTTP/1.1" 200 None
2026-03-27 11:32:34 [auto1.be] INFO: Scrape type for PM47313: 0
2026-03-27 11:32:34 [auto1.be] INFO: Found listing with ID: UM50519
2026-03-27 11:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:35 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:35 [auto1.be] INFO: Found listing with ID: MB10868
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB10868%27 HTTP/1.1" 200 None
2026-03-27 11:32:35 [auto1.be] INFO: Scrape type for MB10868: 0
2026-03-27 11:32:35 [auto1.be] INFO: Found listing with ID: EP21632
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP21632%27 HTTP/1.1" 200 None
2026-03-27 11:32:35 [auto1.be] INFO: Scrape type for EP21632: 0
2026-03-27 11:32:35 [auto1.be] INFO: Found listing with ID: RA35148
2026-03-27 11:32:35 [auto1.be] INFO: Found listing with ID: GT81983
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT81983%27 HTTP/1.1" 200 None
2026-03-27 11:32:35 [auto1.be] INFO: Scrape type for GT81983: 2
2026-03-27 11:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22b268ab-0a79-505e-ae60-c93294320f70 with identifier: GT81983
2026-03-27 11:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b268ab-0a79-505e-ae60-c93294320f70 with scrape type 2
2026-03-27 11:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22b268ab-0a79-505e-ae60-c93294320f70 with scrape type 2
2026-03-27 11:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 22b268ab-0a79-505e-ae60-c93294320f70, identifier: GT81983
2026-03-27 11:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 22b268ab-0a79-505e-ae60-c93294320f70 with identifier: GT81983
2026-03-27 11:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 22b268ab-0a79-505e-ae60-c93294320f70 with identifier: GT81983
2026-03-27 11:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 22b268ab-0a79-505e-ae60-c93294320f70 with identifier: GT81983 to the API
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:00:35Z',
 'fuel_type': 'diesel',
 'id': '22b268ab-0a79-505e-ae60-c93294320f70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT81983',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 199443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-18',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 1.6 dCi 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2014}
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT81983%27 HTTP/1.1" 200 None
2026-03-27 11:32:35 [auto1.be] INFO: Saving data for GT81983: {'auction_closing_time': 1774627235.0, 'created_time': 1773779815.983063, 'last_price_update_time': 1774611155.59621}
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GT81983') HTTP/1.1" 204 0
2026-03-27 11:32:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:35 [auto1.be] INFO: Found listing with ID: SJ45947
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ45947%27 HTTP/1.1" 200 None
2026-03-27 11:32:35 [auto1.be] INFO: Scrape type for SJ45947: 0
2026-03-27 11:32:35 [auto1.be] INFO: Found listing with ID: EX70001
2026-03-27 11:32:35 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-27 11:32:35 [auto1.be] INFO: Found listing with ID: JV20060
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV20060%27 HTTP/1.1" 200 None
2026-03-27 11:32:35 [auto1.be] INFO: Scrape type for JV20060: 0
2026-03-27 11:32:35 [auto1.be] INFO: Found listing with ID: ZW65724
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW65724%27 HTTP/1.1" 200 None
2026-03-27 11:32:35 [auto1.be] INFO: Scrape type for ZW65724: 0
2026-03-27 11:32:35 [auto1.be] INFO: Found listing with ID: AP34233
2026-03-27 11:32:35 [auto1.be] INFO: Found listing with ID: XT57360
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT57360%27 HTTP/1.1" 200 None
2026-03-27 11:32:35 [auto1.be] INFO: Scrape type for XT57360: 0
2026-03-27 11:32:35 [auto1.be] INFO: Found listing with ID: LB88275
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB88275%27 HTTP/1.1" 200 None
2026-03-27 11:32:35 [auto1.be] INFO: Scrape type for LB88275: 2
2026-03-27 11:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e03524e-42cd-5443-b7db-4b432d6c0bd0 with identifier: LB88275
2026-03-27 11:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e03524e-42cd-5443-b7db-4b432d6c0bd0 with scrape type 2
2026-03-27 11:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e03524e-42cd-5443-b7db-4b432d6c0bd0 with scrape type 2
2026-03-27 11:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3e03524e-42cd-5443-b7db-4b432d6c0bd0, identifier: LB88275
2026-03-27 11:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3e03524e-42cd-5443-b7db-4b432d6c0bd0 with identifier: LB88275
2026-03-27 11:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3e03524e-42cd-5443-b7db-4b432d6c0bd0 with identifier: LB88275
2026-03-27 11:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3e03524e-42cd-5443-b7db-4b432d6c0bd0 with identifier: LB88275 to the API
2026-03-27 11:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-27T16:39:31Z',
 'fuel_type': 'diesel',
 'id': '3e03524e-42cd-5443-b7db-4b432d6c0bd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB88275',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 169385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-13',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB88275%27 HTTP/1.1" 200 None
2026-03-27 11:32:36 [auto1.be] INFO: Saving data for LB88275: {'auction_closing_time': 1774629571.0, 'created_time': 1774427449.524974, 'last_price_update_time': 1774611156.218211}
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LB88275') HTTP/1.1" 204 0
2026-03-27 11:32:36 [auto1.be] INFO: Found listing with ID: DC51589
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC51589%27 HTTP/1.1" 200 None
2026-03-27 11:32:36 [auto1.be] INFO: Scrape type for DC51589: 0
2026-03-27 11:32:36 [auto1.be] INFO: Found listing with ID: CP79509
2026-03-27 11:32:36 [auto1.be] INFO: Found listing with ID: FN58645
2026-03-27 11:32:36 [auto1.be] INFO: Found listing with ID: WP96232
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP96232%27 HTTP/1.1" 200 None
2026-03-27 11:32:36 [auto1.be] INFO: Scrape type for WP96232: 2
2026-03-27 11:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3622f2d6-f114-5751-8e5e-2e0c34e9ac82 with identifier: WP96232
2026-03-27 11:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3622f2d6-f114-5751-8e5e-2e0c34e9ac82 with scrape type 2
2026-03-27 11:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3622f2d6-f114-5751-8e5e-2e0c34e9ac82 with scrape type 2
2026-03-27 11:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3622f2d6-f114-5751-8e5e-2e0c34e9ac82, identifier: WP96232
2026-03-27 11:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3622f2d6-f114-5751-8e5e-2e0c34e9ac82 with identifier: WP96232
2026-03-27 11:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3622f2d6-f114-5751-8e5e-2e0c34e9ac82 with identifier: WP96232
2026-03-27 11:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3622f2d6-f114-5751-8e5e-2e0c34e9ac82 with identifier: WP96232 to the API
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-27T16:24:51Z',
 'fuel_type': 'petrol',
 'id': '3622f2d6-f114-5751-8e5e-2e0c34e9ac82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP96232',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 150338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP96232%27 HTTP/1.1" 200 None
2026-03-27 11:32:36 [auto1.be] INFO: Saving data for WP96232: {'auction_closing_time': 1774628691.0, 'created_time': 1773131926.225115, 'last_price_update_time': 1774611156.663343}
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP96232') HTTP/1.1" 204 0
2026-03-27 11:32:36 [auto1.be] INFO: Found listing with ID: FR29123
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR29123%27 HTTP/1.1" 200 None
2026-03-27 11:32:36 [auto1.be] INFO: Scrape type for FR29123: 2
2026-03-27 11:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48e966c7-2c34-5361-a220-0ce2860d04d9 with identifier: FR29123
2026-03-27 11:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48e966c7-2c34-5361-a220-0ce2860d04d9 with scrape type 2
2026-03-27 11:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48e966c7-2c34-5361-a220-0ce2860d04d9 with scrape type 2
2026-03-27 11:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 48e966c7-2c34-5361-a220-0ce2860d04d9, identifier: FR29123
2026-03-27 11:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 48e966c7-2c34-5361-a220-0ce2860d04d9 with identifier: FR29123
2026-03-27 11:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 48e966c7-2c34-5361-a220-0ce2860d04d9 with identifier: FR29123
2026-03-27 11:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 48e966c7-2c34-5361-a220-0ce2860d04d9 with identifier: FR29123 to the API
2026-03-27 11:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:00:44Z',
 'fuel_type': 'diesel',
 'id': '48e966c7-2c34-5361-a220-0ce2860d04d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR29123',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 224070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-26',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 CDTI DPF Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2014}
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR29123%27 HTTP/1.1" 200 None
2026-03-27 11:32:37 [auto1.be] INFO: Saving data for FR29123: {'auction_closing_time': 1774627244.0, 'created_time': 1773136593.136235, 'last_price_update_time': 1774611157.20491}
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FR29123') HTTP/1.1" 204 0
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: VB86156
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB86156%27 HTTP/1.1" 200 None
2026-03-27 11:32:37 [auto1.be] INFO: Scrape type for VB86156: 0
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: SB65944
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB65944%27 HTTP/1.1" 200 None
2026-03-27 11:32:37 [auto1.be] INFO: Scrape type for SB65944: 0
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: TX50004
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50004%27 HTTP/1.1" 200 None
2026-03-27 11:32:37 [auto1.be] INFO: Scrape type for TX50004: 0
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: ZT51851
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT51851%27 HTTP/1.1" 200 None
2026-03-27 11:32:37 [auto1.be] INFO: Scrape type for ZT51851: 2
2026-03-27 11:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b96c14d-a145-5a79-893e-df215439275b with identifier: ZT51851
2026-03-27 11:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b96c14d-a145-5a79-893e-df215439275b with scrape type 2
2026-03-27 11:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b96c14d-a145-5a79-893e-df215439275b with scrape type 2
2026-03-27 11:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b96c14d-a145-5a79-893e-df215439275b, identifier: ZT51851
2026-03-27 11:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b96c14d-a145-5a79-893e-df215439275b with identifier: ZT51851
2026-03-27 11:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b96c14d-a145-5a79-893e-df215439275b with identifier: ZT51851
2026-03-27 11:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b96c14d-a145-5a79-893e-df215439275b with identifier: ZT51851 to the API
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:38:12Z',
 'fuel_type': 'diesel',
 'id': '1b96c14d-a145-5a79-893e-df215439275b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT51851',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS4',
 'odometer': 246393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-24',
 'seller_name': None,
 'title': 'Citroen DS4 1.6 HDi Chic',
 'transmission': 'manual',
 'trim': 'Chic',
 'year': 2013}
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT51851%27 HTTP/1.1" 200 None
2026-03-27 11:32:37 [auto1.be] INFO: Saving data for ZT51851: {'auction_closing_time': 1774629492.0, 'created_time': 1773301748.00529, 'last_price_update_time': 1774611157.715187}
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZT51851') HTTP/1.1" 204 0
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: BW33420
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW33420%27 HTTP/1.1" 200 None
2026-03-27 11:32:37 [auto1.be] INFO: Scrape type for BW33420: 0
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: AW12506
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: CT01503
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT01503%27 HTTP/1.1" 200 None
2026-03-27 11:32:37 [auto1.be] INFO: Scrape type for CT01503: 0
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: CT13116
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: BU20603
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: YC93311
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC93311%27 HTTP/1.1" 200 None
2026-03-27 11:32:37 [auto1.be] INFO: Scrape type for YC93311: 0
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: PA07784
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: WX02409
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX02409%27 HTTP/1.1" 200 None
2026-03-27 11:32:37 [auto1.be] INFO: Scrape type for WX02409: 0
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: NZ68355
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ68355%27 HTTP/1.1" 200 None
2026-03-27 11:32:37 [auto1.be] INFO: Scrape type for NZ68355: 0
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: VM27980
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM27980%27 HTTP/1.1" 200 None
2026-03-27 11:32:37 [auto1.be] INFO: Scrape type for VM27980: 0
2026-03-27 11:32:37 [auto1.be] INFO: Found listing with ID: JT16310
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT16310%27 HTTP/1.1" 200 None
2026-03-27 11:32:37 [auto1.be] INFO: Scrape type for JT16310: 2
2026-03-27 11:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f83faf-824c-5c09-909b-ff8d72ee4514 with identifier: JT16310
2026-03-27 11:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f83faf-824c-5c09-909b-ff8d72ee4514 with scrape type 2
2026-03-27 11:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17f83faf-824c-5c09-909b-ff8d72ee4514 with scrape type 2
2026-03-27 11:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17f83faf-824c-5c09-909b-ff8d72ee4514, identifier: JT16310
2026-03-27 11:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17f83faf-824c-5c09-909b-ff8d72ee4514 with identifier: JT16310
2026-03-27 11:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17f83faf-824c-5c09-909b-ff8d72ee4514 with identifier: JT16310
2026-03-27 11:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17f83faf-824c-5c09-909b-ff8d72ee4514 with identifier: JT16310 to the API
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-27T16:38:44Z',
 'fuel_type': 'diesel',
 'id': '17f83faf-824c-5c09-909b-ff8d72ee4514',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT16310',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 222007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-15',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT16310%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Saving data for JT16310: {'auction_closing_time': 1774629524.0, 'created_time': 1774427444.470755, 'last_price_update_time': 1774611158.271211}
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JT16310') HTTP/1.1" 204 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: YB34897
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: DT44813
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: GP11824
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP11824%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for GP11824: 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: SN36947
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN36947%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for SN36947: 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: DV43116
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV43116%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for DV43116: 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: DG23059
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: TW50978
2026-03-27 11:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:38 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: ZM59718
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM59718%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for ZM59718: 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: UT07504
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: GH28824
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH28824%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for GH28824: 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: UA36115
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36115%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for UA36115: 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: SP41494
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: UA36562
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36562%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for UA36562: 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: CE95179
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for TS87416: 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: LF65980
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: YP24306
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for VP73114: 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: RJ35563
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: CG04214
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: AS73596
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS73596%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for AS73596: 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: ZJ69289
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ69289%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for ZJ69289: 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: LB52674
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB52674%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for LB52674: 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: LB99980
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB99980%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for LB99980: 0
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: MR44504
2026-03-27 11:32:38 [auto1.be] INFO: Found listing with ID: AB27373
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB27373%27 HTTP/1.1" 200 None
2026-03-27 11:32:38 [auto1.be] INFO: Scrape type for AB27373: 2
2026-03-27 11:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64d23fd-7559-5100-a9fb-873d72482dd4 with identifier: AB27373
2026-03-27 11:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64d23fd-7559-5100-a9fb-873d72482dd4 with scrape type 2
2026-03-27 11:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64d23fd-7559-5100-a9fb-873d72482dd4 with scrape type 2
2026-03-27 11:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e64d23fd-7559-5100-a9fb-873d72482dd4, identifier: AB27373
2026-03-27 11:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e64d23fd-7559-5100-a9fb-873d72482dd4 with identifier: AB27373
2026-03-27 11:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e64d23fd-7559-5100-a9fb-873d72482dd4 with identifier: AB27373
2026-03-27 11:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e64d23fd-7559-5100-a9fb-873d72482dd4 with identifier: AB27373 to the API
2026-03-27 11:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-27T16:03:43Z',
 'fuel_type': 'petrol',
 'id': 'e64d23fd-7559-5100-a9fb-873d72482dd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB27373',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 115776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-04',
 'seller_name': None,
 'title': 'BMW 6er 630i GT Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB27373%27 HTTP/1.1" 200 None
2026-03-27 11:32:39 [auto1.be] INFO: Saving data for AB27373: {'auction_closing_time': 1774627423.0, 'created_time': 1774427447.969274, 'last_price_update_time': 1774611159.178243}
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB27373') HTTP/1.1" 204 0
2026-03-27 11:32:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: MG85260
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG85260%27 HTTP/1.1" 200 None
2026-03-27 11:32:39 [auto1.be] INFO: Scrape type for MG85260: 0
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: HJ68076
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: GB58536
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB58536%27 HTTP/1.1" 200 None
2026-03-27 11:32:39 [auto1.be] INFO: Scrape type for GB58536: 0
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: KM78271
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: JV15040
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: HU32342
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: WJ27954
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY90857%27 HTTP/1.1" 200 None
2026-03-27 11:32:39 [auto1.be] INFO: Scrape type for DY90857: 0
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: ED19448
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED19448%27 HTTP/1.1" 200 None
2026-03-27 11:32:39 [auto1.be] INFO: Scrape type for ED19448: 0
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: HB89666
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: EP89086
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: BZ90658
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: VE77274
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: EW69496
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14526%27 HTTP/1.1" 200 None
2026-03-27 11:32:39 [auto1.be] INFO: Scrape type for ZH14526: 0
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: SB72599
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB72599%27 HTTP/1.1" 200 None
2026-03-27 11:32:39 [auto1.be] INFO: Scrape type for SB72599: 0
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: NX65189
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: PM01908
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM01908%27 HTTP/1.1" 200 None
2026-03-27 11:32:39 [auto1.be] INFO: Scrape type for PM01908: 0
2026-03-27 11:32:39 [auto1.be] INFO: Found listing with ID: HH99253
2026-03-27 11:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:40 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: FT14375
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: AG59178
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG59178%27 HTTP/1.1" 200 None
2026-03-27 11:32:40 [auto1.be] INFO: Scrape type for AG59178: 0
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: TK17368
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK17368%27 HTTP/1.1" 200 None
2026-03-27 11:32:40 [auto1.be] INFO: Scrape type for TK17368: 0
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: SX76756
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: DJ10477
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ10477%27 HTTP/1.1" 200 None
2026-03-27 11:32:40 [auto1.be] INFO: Scrape type for DJ10477: 0
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: TK82832
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: AC35394
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: MA95611
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: EM34677
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM34677%27 HTTP/1.1" 200 None
2026-03-27 11:32:40 [auto1.be] INFO: Scrape type for EM34677: 0
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: KS30497
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: BN01077
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: FU61214
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: EA51095
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA51095%27 HTTP/1.1" 200 None
2026-03-27 11:32:40 [auto1.be] INFO: Scrape type for EA51095: 0
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: ZW46984
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: BD44372
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: EA67135
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA67135%27 HTTP/1.1" 200 None
2026-03-27 11:32:40 [auto1.be] INFO: Scrape type for EA67135: 0
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: NP31982
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP31982%27 HTTP/1.1" 200 None
2026-03-27 11:32:40 [auto1.be] INFO: Scrape type for NP31982: 0
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: TN36699
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: EW19960
2026-03-27 11:32:40 [auto1.be] INFO: Found listing with ID: TA69601
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA69601%27 HTTP/1.1" 200 None
2026-03-27 11:32:40 [auto1.be] INFO: Scrape type for TA69601: 2
2026-03-27 11:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce56522c-11c6-5044-87f9-e99184442d7b with identifier: TA69601
2026-03-27 11:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce56522c-11c6-5044-87f9-e99184442d7b with scrape type 2
2026-03-27 11:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce56522c-11c6-5044-87f9-e99184442d7b with scrape type 2
2026-03-27 11:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ce56522c-11c6-5044-87f9-e99184442d7b, identifier: TA69601
2026-03-27 11:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ce56522c-11c6-5044-87f9-e99184442d7b with identifier: TA69601
2026-03-27 11:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ce56522c-11c6-5044-87f9-e99184442d7b with identifier: TA69601
2026-03-27 11:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ce56522c-11c6-5044-87f9-e99184442d7b with identifier: TA69601 to the API
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:43:23Z',
 'fuel_type': 'diesel',
 'id': 'ce56522c-11c6-5044-87f9-e99184442d7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA69601',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 243305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-08',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2010}
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA69601%27 HTTP/1.1" 200 None
2026-03-27 11:32:40 [auto1.be] INFO: Saving data for TA69601: {'auction_closing_time': 1774629803.0, 'created_time': 1774341037.550926, 'last_price_update_time': 1774611160.984024}
2026-03-27 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TA69601') HTTP/1.1" 204 0
2026-03-27 11:32:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:41 [auto1.be] INFO: Found listing with ID: BL90770
2026-03-27 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BL90770%27 HTTP/1.1" 200 None
2026-03-27 11:32:41 [auto1.be] INFO: Scrape type for BL90770: 0
2026-03-27 11:32:41 [auto1.be] INFO: Found listing with ID: HN52312
2026-03-27 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN52312%27 HTTP/1.1" 200 None
2026-03-27 11:32:41 [auto1.be] INFO: Scrape type for HN52312: 0
2026-03-27 11:32:41 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-27 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY23736%27 HTTP/1.1" 200 None
2026-03-27 11:32:41 [auto1.be] INFO: Scrape type for ZY23736: 2
2026-03-27 11:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de252dbf-0eab-5762-be54-0ccca4a71df7 with identifier: ZY23736
2026-03-27 11:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de252dbf-0eab-5762-be54-0ccca4a71df7 with scrape type 2
2026-03-27 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de252dbf-0eab-5762-be54-0ccca4a71df7 with scrape type 2
2026-03-27 11:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: de252dbf-0eab-5762-be54-0ccca4a71df7, identifier: ZY23736
2026-03-27 11:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: de252dbf-0eab-5762-be54-0ccca4a71df7 with identifier: ZY23736
2026-03-27 11:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: de252dbf-0eab-5762-be54-0ccca4a71df7 with identifier: ZY23736
2026-03-27 11:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: de252dbf-0eab-5762-be54-0ccca4a71df7 with identifier: ZY23736 to the API
2026-03-27 11:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:54:50Z',
 'fuel_type': 'diesel',
 'id': 'de252dbf-0eab-5762-be54-0ccca4a71df7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY23736',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 105897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-26',
 'seller_name': None,
 'title': 'Fiat 500L 1.6 JTDM Trekking',
 'transmission': 'manual',
 'trim': 'Trekking',
 'year': 2014}
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY23736%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Saving data for ZY23736: {'auction_closing_time': 1774630490.0, 'created_time': 1773136813.775461, 'last_price_update_time': 1774611162.064174}
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY23736') HTTP/1.1" 204 0
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: ME25565
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME25565%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Scrape type for ME25565: 0
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: FC96000
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC96000%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Scrape type for FC96000: 0
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56663%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Scrape type for CW56663: 0
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: CY39979
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY39979%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Scrape type for CY39979: 2
2026-03-27 11:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d43ac93-4626-5e9e-89ba-c822806f93c8 with identifier: CY39979
2026-03-27 11:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d43ac93-4626-5e9e-89ba-c822806f93c8 with scrape type 2
2026-03-27 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d43ac93-4626-5e9e-89ba-c822806f93c8 with scrape type 2
2026-03-27 11:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d43ac93-4626-5e9e-89ba-c822806f93c8, identifier: CY39979
2026-03-27 11:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d43ac93-4626-5e9e-89ba-c822806f93c8 with identifier: CY39979
2026-03-27 11:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d43ac93-4626-5e9e-89ba-c822806f93c8 with identifier: CY39979
2026-03-27 11:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d43ac93-4626-5e9e-89ba-c822806f93c8 with identifier: CY39979 to the API
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:13:34Z',
 'fuel_type': 'diesel',
 'id': '9d43ac93-4626-5e9e-89ba-c822806f93c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY39979',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 166934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-08',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY39979%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Saving data for CY39979: {'auction_closing_time': 1774628014.0, 'created_time': 1773301668.296279, 'last_price_update_time': 1774611162.529823}
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CY39979') HTTP/1.1" 204 0
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: KA04949
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA04949%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Scrape type for KA04949: 0
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: XF90058
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: CF07146
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF07146%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Scrape type for CF07146: 0
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: EA43568
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA43568%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Scrape type for EA43568: 0
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: UR56668
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR56668%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Scrape type for UR56668: 0
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: XP29569
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP29569%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Scrape type for XP29569: 0
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: ZY27857
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: ZT60754
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: NH53756
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: XC26287
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC26287%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Scrape type for XC26287: 0
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: GD45895
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD45895%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Scrape type for GD45895: 0
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: AT93174
2026-03-27 11:32:42 [auto1.be] INFO: Found listing with ID: WX47366
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX47366%27 HTTP/1.1" 200 None
2026-03-27 11:32:42 [auto1.be] INFO: Scrape type for WX47366: 0
2026-03-27 11:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:43 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: XS40132
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS40132%27 HTTP/1.1" 200 None
2026-03-27 11:32:43 [auto1.be] INFO: Scrape type for XS40132: 0
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: DK36221
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK36221%27 HTTP/1.1" 200 None
2026-03-27 11:32:43 [auto1.be] INFO: Scrape type for DK36221: 0
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: XT74022
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: TP88301
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP88301%27 HTTP/1.1" 200 None
2026-03-27 11:32:43 [auto1.be] INFO: Scrape type for TP88301: 0
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: BR56000
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: MB05626
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB05626%27 HTTP/1.1" 200 None
2026-03-27 11:32:43 [auto1.be] INFO: Scrape type for MB05626: 0
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: GE98600
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: XC86305
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: DM10374
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM10374%27 HTTP/1.1" 200 None
2026-03-27 11:32:43 [auto1.be] INFO: Scrape type for DM10374: 0
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: DY53822
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: FH43891
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH43891%27 HTTP/1.1" 200 None
2026-03-27 11:32:43 [auto1.be] INFO: Scrape type for FH43891: 0
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: WM23056
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: ML32022
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: WR44467
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR44467%27 HTTP/1.1" 200 None
2026-03-27 11:32:43 [auto1.be] INFO: Scrape type for WR44467: 0
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: GX95713
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX95713%27 HTTP/1.1" 200 None
2026-03-27 11:32:43 [auto1.be] INFO: Scrape type for GX95713: 0
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: EB16456
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB16456%27 HTTP/1.1" 200 None
2026-03-27 11:32:43 [auto1.be] INFO: Scrape type for EB16456: 0
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: ZZ76068
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ76068%27 HTTP/1.1" 200 None
2026-03-27 11:32:43 [auto1.be] INFO: Scrape type for ZZ76068: 0
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: NF63760
2026-03-27 11:32:43 [auto1.be] INFO: Found listing with ID: TC10006
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC10006%27 HTTP/1.1" 200 None
2026-03-27 11:32:43 [auto1.be] INFO: Scrape type for TC10006: 2
2026-03-27 11:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c571d335-4ca3-52dd-bf3d-66a5e4caeb31 with identifier: TC10006
2026-03-27 11:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c571d335-4ca3-52dd-bf3d-66a5e4caeb31 with scrape type 2
2026-03-27 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c571d335-4ca3-52dd-bf3d-66a5e4caeb31 with scrape type 2
2026-03-27 11:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c571d335-4ca3-52dd-bf3d-66a5e4caeb31, identifier: TC10006
2026-03-27 11:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c571d335-4ca3-52dd-bf3d-66a5e4caeb31 with identifier: TC10006
2026-03-27 11:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c571d335-4ca3-52dd-bf3d-66a5e4caeb31 with identifier: TC10006
2026-03-27 11:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c571d335-4ca3-52dd-bf3d-66a5e4caeb31 with identifier: TC10006 to the API
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:33:28Z',
 'fuel_type': 'petrol',
 'id': 'c571d335-4ca3-52dd-bf3d-66a5e4caeb31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC10006',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 64092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-29',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.3 TCe Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2023}
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC10006%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Saving data for TC10006: {'auction_closing_time': 1774629208.0, 'created_time': 1774427454.964936, 'last_price_update_time': 1774611164.095592}
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TC10006') HTTP/1.1" 204 0
2026-03-27 11:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: UX70037
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: ST35840
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST35840%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Scrape type for ST35840: 0
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: TE87382
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE87382%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Scrape type for TE87382: 2
2026-03-27 11:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eae9bf5d-75f2-5f36-a8e4-bcb49b1e02f0 with identifier: TE87382
2026-03-27 11:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eae9bf5d-75f2-5f36-a8e4-bcb49b1e02f0 with scrape type 2
2026-03-27 11:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eae9bf5d-75f2-5f36-a8e4-bcb49b1e02f0 with scrape type 2
2026-03-27 11:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eae9bf5d-75f2-5f36-a8e4-bcb49b1e02f0, identifier: TE87382
2026-03-27 11:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eae9bf5d-75f2-5f36-a8e4-bcb49b1e02f0 with identifier: TE87382
2026-03-27 11:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eae9bf5d-75f2-5f36-a8e4-bcb49b1e02f0 with identifier: TE87382
2026-03-27 11:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eae9bf5d-75f2-5f36-a8e4-bcb49b1e02f0 with identifier: TE87382 to the API
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:04:18Z',
 'fuel_type': 'diesel',
 'id': 'eae9bf5d-75f2-5f36-a8e4-bcb49b1e02f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE87382',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 163137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-02',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE87382%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Saving data for TE87382: {'auction_closing_time': 1774627458.0, 'created_time': 1774341049.955046, 'last_price_update_time': 1774611164.684084}
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TE87382') HTTP/1.1" 204 0
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: AK14209
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK14209%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Scrape type for AK14209: 0
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: YK73826
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73826%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Scrape type for YK73826: 0
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: LG17497
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG17497%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Scrape type for LG17497: 0
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: TZ22739
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ22739%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Scrape type for TZ22739: 0
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: LB60883
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB60883%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Scrape type for LB60883: 0
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: YL95058
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: NP87608
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP87608%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Scrape type for NP87608: 0
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: AJ66788
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: WY74767
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY74767%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Scrape type for WY74767: 0
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: VR94572
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR94572%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Scrape type for VR94572: 0
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: RD12029
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: WT96819
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: FE85433
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: XU56519
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU56519%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Scrape type for XU56519: 0
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: AU97754
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU97754%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Scrape type for AU97754: 0
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: YD98254
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD98254%27 HTTP/1.1" 200 None
2026-03-27 11:32:44 [auto1.be] INFO: Scrape type for YD98254: 0
2026-03-27 11:32:44 [auto1.be] INFO: Found listing with ID: EJ73890
2026-03-27 11:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:45 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:45 [auto1.be] INFO: Found listing with ID: LT40648
2026-03-27 11:32:45 [auto1.be] INFO: Found listing with ID: ZC75548
2026-03-27 11:32:45 [auto1.be] INFO: Found listing with ID: YS23980
2026-03-27 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS23980%27 HTTP/1.1" 200 None
2026-03-27 11:32:45 [auto1.be] INFO: Scrape type for YS23980: 0
2026-03-27 11:32:45 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-27 11:32:45 [auto1.be] INFO: Found listing with ID: ET36729
2026-03-27 11:32:45 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-27 11:32:45 [auto1.be] INFO: Found listing with ID: JT53562
2026-03-27 11:32:45 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-27 11:32:45 [auto1.be] INFO: Found listing with ID: FE67776
2026-03-27 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE67776%27 HTTP/1.1" 200 None
2026-03-27 11:32:45 [auto1.be] INFO: Scrape type for FE67776: 0
2026-03-27 11:32:45 [auto1.be] INFO: Found listing with ID: JA35484
2026-03-27 11:32:45 [auto1.be] INFO: Found listing with ID: ZM60414
2026-03-27 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM60414%27 HTTP/1.1" 200 None
2026-03-27 11:32:45 [auto1.be] INFO: Scrape type for ZM60414: 2
2026-03-27 11:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06c87356-dbed-5262-bc2a-b6261d317b68 with identifier: ZM60414
2026-03-27 11:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06c87356-dbed-5262-bc2a-b6261d317b68 with scrape type 2
2026-03-27 11:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06c87356-dbed-5262-bc2a-b6261d317b68 with scrape type 2
2026-03-27 11:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 06c87356-dbed-5262-bc2a-b6261d317b68, identifier: ZM60414
2026-03-27 11:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 06c87356-dbed-5262-bc2a-b6261d317b68 with identifier: ZM60414
2026-03-27 11:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 06c87356-dbed-5262-bc2a-b6261d317b68 with identifier: ZM60414
2026-03-27 11:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 06c87356-dbed-5262-bc2a-b6261d317b68 with identifier: ZM60414 to the API
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:49:08Z',
 'fuel_type': 'petrol',
 'id': '06c87356-dbed-5262-bc2a-b6261d317b68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM60414',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 168794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-31',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2020}
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM60414%27 HTTP/1.1" 200 None
2026-03-27 11:32:46 [auto1.be] INFO: Saving data for ZM60414: {'auction_closing_time': 1774630148.0, 'created_time': 1773779718.480381, 'last_price_update_time': 1774611166.283436}
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM60414') HTTP/1.1" 204 0
2026-03-27 11:32:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: JP36174
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: RU23480
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU23480%27 HTTP/1.1" 200 None
2026-03-27 11:32:46 [auto1.be] INFO: Scrape type for RU23480: 0
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: FB99021
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: UD45349
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: GG52941
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG52941%27 HTTP/1.1" 200 None
2026-03-27 11:32:46 [auto1.be] INFO: Scrape type for GG52941: 0
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: AX50083
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: XM90245
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: PZ19137
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ19137%27 HTTP/1.1" 200 None
2026-03-27 11:32:46 [auto1.be] INFO: Scrape type for PZ19137: 0
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: KR25355
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR25355%27 HTTP/1.1" 200 None
2026-03-27 11:32:46 [auto1.be] INFO: Scrape type for KR25355: 0
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: UW02505
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW02505%27 HTTP/1.1" 200 None
2026-03-27 11:32:46 [auto1.be] INFO: Scrape type for UW02505: 0
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: HF70171
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF70171%27 HTTP/1.1" 200 None
2026-03-27 11:32:46 [auto1.be] INFO: Scrape type for HF70171: 0
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: MV08230
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV08230%27 HTTP/1.1" 200 None
2026-03-27 11:32:46 [auto1.be] INFO: Scrape type for MV08230: 0
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: ZL48181
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: VP65458
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: CG87978
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG87978%27 HTTP/1.1" 200 None
2026-03-27 11:32:46 [auto1.be] INFO: Scrape type for CG87978: 0
2026-03-27 11:32:46 [auto1.be] INFO: Found listing with ID: LL17745
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL17745%27 HTTP/1.1" 200 None
2026-03-27 11:32:46 [auto1.be] INFO: Scrape type for LL17745: 2
2026-03-27 11:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2741c7f-d889-5a53-9e68-c37a4064fbc3 with identifier: LL17745
2026-03-27 11:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2741c7f-d889-5a53-9e68-c37a4064fbc3 with scrape type 2
2026-03-27 11:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2741c7f-d889-5a53-9e68-c37a4064fbc3 with scrape type 2
2026-03-27 11:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a2741c7f-d889-5a53-9e68-c37a4064fbc3, identifier: LL17745
2026-03-27 11:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a2741c7f-d889-5a53-9e68-c37a4064fbc3 with identifier: LL17745
2026-03-27 11:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a2741c7f-d889-5a53-9e68-c37a4064fbc3 with identifier: LL17745
2026-03-27 11:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a2741c7f-d889-5a53-9e68-c37a4064fbc3 with identifier: LL17745 to the API
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:20:34Z',
 'fuel_type': 'petrol',
 'id': 'a2741c7f-d889-5a53-9e68-c37a4064fbc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL17745',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 166958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-12',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL17745%27 HTTP/1.1" 200 None
2026-03-27 11:32:46 [auto1.be] INFO: Saving data for LL17745: {'auction_closing_time': 1774628434.0, 'created_time': 1774427445.887707, 'last_price_update_time': 1774611166.954727}
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LL17745') HTTP/1.1" 204 0
2026-03-27 11:32:47 [auto1.be] INFO: Found listing with ID: HW03040
2026-03-27 11:32:47 [auto1.be] INFO: Found listing with ID: BY76075
2026-03-27 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY76075%27 HTTP/1.1" 200 None
2026-03-27 11:32:47 [auto1.be] INFO: Scrape type for BY76075: 0
2026-03-27 11:32:47 [auto1.be] INFO: Found listing with ID: EM93050
2026-03-27 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM93050%27 HTTP/1.1" 200 None
2026-03-27 11:32:47 [auto1.be] INFO: Scrape type for EM93050: 0
2026-03-27 11:32:47 [auto1.be] INFO: Found listing with ID: YC12895
2026-03-27 11:32:47 [auto1.be] INFO: Found listing with ID: RE83981
2026-03-27 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE83981%27 HTTP/1.1" 200 None
2026-03-27 11:32:47 [auto1.be] INFO: Scrape type for RE83981: 0
2026-03-27 11:32:47 [auto1.be] INFO: Found listing with ID: NY90859
2026-03-27 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY90859%27 HTTP/1.1" 200 None
2026-03-27 11:32:47 [auto1.be] INFO: Scrape type for NY90859: 0
2026-03-27 11:32:47 [auto1.be] INFO: Found listing with ID: GR59169
2026-03-27 11:32:47 [auto1.be] INFO: Found listing with ID: NY73004
2026-03-27 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY73004%27 HTTP/1.1" 200 None
2026-03-27 11:32:47 [auto1.be] INFO: Scrape type for NY73004: 0
2026-03-27 11:32:47 [auto1.be] INFO: Found listing with ID: VH76362
2026-03-27 11:32:47 [auto1.be] INFO: Found listing with ID: PJ29729
2026-03-27 11:32:47 [auto1.be] INFO: Found listing with ID: NX44196
2026-03-27 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NX44196%27 HTTP/1.1" 200 None
2026-03-27 11:32:47 [auto1.be] INFO: Scrape type for NX44196: 0
2026-03-27 11:32:47 [auto1.be] INFO: Found listing with ID: NJ72085
2026-03-27 11:32:47 [auto1.be] INFO: Found listing with ID: XV08295
2026-03-27 11:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:49 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:49 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-27 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH78267%27 HTTP/1.1" 200 None
2026-03-27 11:32:49 [auto1.be] INFO: Scrape type for PH78267: 2
2026-03-27 11:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4694cb80-4835-5f89-beaf-7a86c80e548b with identifier: PH78267
2026-03-27 11:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4694cb80-4835-5f89-beaf-7a86c80e548b with scrape type 2
2026-03-27 11:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4694cb80-4835-5f89-beaf-7a86c80e548b with scrape type 2
2026-03-27 11:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4694cb80-4835-5f89-beaf-7a86c80e548b, identifier: PH78267
2026-03-27 11:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4694cb80-4835-5f89-beaf-7a86c80e548b with identifier: PH78267
2026-03-27 11:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4694cb80-4835-5f89-beaf-7a86c80e548b with identifier: PH78267
2026-03-27 11:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4694cb80-4835-5f89-beaf-7a86c80e548b with identifier: PH78267 to the API
2026-03-27 11:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:08:00Z',
 'fuel_type': 'diesel',
 'id': '4694cb80-4835-5f89-beaf-7a86c80e548b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH78267',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Epica',
 'odometer': 235028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-26',
 'seller_name': None,
 'title': 'Chevrolet Epica 2.0 Diesel LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2009}
2026-03-27 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH78267%27 HTTP/1.1" 200 None
2026-03-27 11:32:50 [auto1.be] INFO: Saving data for PH78267: {'auction_closing_time': 1774627680.0, 'created_time': 1773134610.20965, 'last_price_update_time': 1774611170.073878}
2026-03-27 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PH78267') HTTP/1.1" 204 0
2026-03-27 11:32:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:50 [auto1.be] INFO: Found listing with ID: ZV64637
2026-03-27 11:32:50 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-27 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-27 11:32:50 [auto1.be] INFO: Scrape type for ZC67013: 0
2026-03-27 11:32:50 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-27 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW28444%27 HTTP/1.1" 200 None
2026-03-27 11:32:50 [auto1.be] INFO: Scrape type for JW28444: 2
2026-03-27 11:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd07124-f44e-5898-aece-38964db9001a with identifier: JW28444
2026-03-27 11:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd07124-f44e-5898-aece-38964db9001a with scrape type 2
2026-03-27 11:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fd07124-f44e-5898-aece-38964db9001a with scrape type 2
2026-03-27 11:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7fd07124-f44e-5898-aece-38964db9001a, identifier: JW28444
2026-03-27 11:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7fd07124-f44e-5898-aece-38964db9001a with identifier: JW28444
2026-03-27 11:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7fd07124-f44e-5898-aece-38964db9001a with identifier: JW28444
2026-03-27 11:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7fd07124-f44e-5898-aece-38964db9001a with identifier: JW28444 to the API
2026-03-27 11:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:25:19Z',
 'fuel_type': 'diesel',
 'id': '7fd07124-f44e-5898-aece-38964db9001a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW28444',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 245383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-03',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2009}
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW28444%27 HTTP/1.1" 200 None
2026-03-27 11:32:51 [auto1.be] INFO: Saving data for JW28444: {'auction_closing_time': 1774628719.0, 'created_time': 1773138258.256078, 'last_price_update_time': 1774611171.378096}
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW28444') HTTP/1.1" 204 0
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: NB44505
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB44505%27 HTTP/1.1" 200 None
2026-03-27 11:32:51 [auto1.be] INFO: Scrape type for NB44505: 0
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: DF67352
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: RB68034
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB68034%27 HTTP/1.1" 200 None
2026-03-27 11:32:51 [auto1.be] INFO: Scrape type for RB68034: 0
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: YA31821
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: YK30671
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: JU50547
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU50547%27 HTTP/1.1" 200 None
2026-03-27 11:32:51 [auto1.be] INFO: Scrape type for JU50547: 0
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: HL07248
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL07248%27 HTTP/1.1" 200 None
2026-03-27 11:32:51 [auto1.be] INFO: Scrape type for HL07248: 0
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: FP33108
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP33108%27 HTTP/1.1" 200 None
2026-03-27 11:32:51 [auto1.be] INFO: Scrape type for FP33108: 0
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS70949%27 HTTP/1.1" 200 None
2026-03-27 11:32:51 [auto1.be] INFO: Scrape type for MS70949: 0
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: RR37378
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR37378%27 HTTP/1.1" 200 None
2026-03-27 11:32:51 [auto1.be] INFO: Scrape type for RR37378: 0
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: SL75096
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL75096%27 HTTP/1.1" 200 None
2026-03-27 11:32:51 [auto1.be] INFO: Scrape type for SL75096: 0
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: XE24003
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: DD10151
2026-03-27 11:32:51 [auto1.be] INFO: Found listing with ID: EA43417
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA43417%27 HTTP/1.1" 200 None
2026-03-27 11:32:51 [auto1.be] INFO: Scrape type for EA43417: 2
2026-03-27 11:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc0e7f0a-9a1f-58d4-aac2-013a144a26a8 with identifier: EA43417
2026-03-27 11:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc0e7f0a-9a1f-58d4-aac2-013a144a26a8 with scrape type 2
2026-03-27 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc0e7f0a-9a1f-58d4-aac2-013a144a26a8 with scrape type 2
2026-03-27 11:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cc0e7f0a-9a1f-58d4-aac2-013a144a26a8, identifier: EA43417
2026-03-27 11:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cc0e7f0a-9a1f-58d4-aac2-013a144a26a8 with identifier: EA43417
2026-03-27 11:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cc0e7f0a-9a1f-58d4-aac2-013a144a26a8 with identifier: EA43417
2026-03-27 11:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cc0e7f0a-9a1f-58d4-aac2-013a144a26a8 with identifier: EA43417 to the API
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:01:25Z',
 'fuel_type': 'diesel',
 'id': 'cc0e7f0a-9a1f-58d4-aac2-013a144a26a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA43417',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'NV300',
 'odometer': 126966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-02',
 'seller_name': None,
 'title': 'Nissan NV300 1.6 dCi L2H1 2,9t Comfort',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Comfort',
 'year': 2019}
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA43417%27 HTTP/1.1" 200 None
2026-03-27 11:32:51 [auto1.be] INFO: Saving data for EA43417: {'auction_closing_time': 1774627285.0, 'created_time': 1773301693.572386, 'last_price_update_time': 1774611171.966138}
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EA43417') HTTP/1.1" 204 0
2026-03-27 11:32:52 [auto1.be] INFO: Found listing with ID: BF19494
2026-03-27 11:32:52 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-27 11:32:52 [auto1.be] INFO: Found listing with ID: PE81992
2026-03-27 11:32:52 [auto1.be] INFO: Found listing with ID: CT32592
2026-03-27 11:32:52 [auto1.be] INFO: Found listing with ID: CD49424
2026-03-27 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD49424%27 HTTP/1.1" 200 None
2026-03-27 11:32:52 [auto1.be] INFO: Scrape type for CD49424: 2
2026-03-27 11:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ddabe0e-41c1-501a-989e-4f173d3d46f9 with identifier: CD49424
2026-03-27 11:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ddabe0e-41c1-501a-989e-4f173d3d46f9 with scrape type 2
2026-03-27 11:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ddabe0e-41c1-501a-989e-4f173d3d46f9 with scrape type 2
2026-03-27 11:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4ddabe0e-41c1-501a-989e-4f173d3d46f9, identifier: CD49424
2026-03-27 11:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4ddabe0e-41c1-501a-989e-4f173d3d46f9 with identifier: CD49424
2026-03-27 11:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4ddabe0e-41c1-501a-989e-4f173d3d46f9 with identifier: CD49424
2026-03-27 11:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4ddabe0e-41c1-501a-989e-4f173d3d46f9 with identifier: CD49424 to the API
2026-03-27 11:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:56:34Z',
 'fuel_type': 'diesel',
 'id': '4ddabe0e-41c1-501a-989e-4f173d3d46f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD49424',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 139332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-20',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD49424%27 HTTP/1.1" 200 None
2026-03-27 11:32:53 [auto1.be] INFO: Saving data for CD49424: {'auction_closing_time': 1774630594.0, 'created_time': 1773134781.965984, 'last_price_update_time': 1774611173.410203}
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CD49424') HTTP/1.1" 204 0
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: AR89710
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AR89710%27 HTTP/1.1" 200 None
2026-03-27 11:32:53 [auto1.be] INFO: Scrape type for AR89710: 0
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-27 11:32:53 [auto1.be] INFO: Scrape type for EX63844: 0
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN34238%27 HTTP/1.1" 200 None
2026-03-27 11:32:53 [auto1.be] INFO: Scrape type for JN34238: 0
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: CK71488
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: WJ28865
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ28865%27 HTTP/1.1" 200 None
2026-03-27 11:32:53 [auto1.be] INFO: Scrape type for WJ28865: 0
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: UJ84188
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: GB85934
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: RY67713
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY67713%27 HTTP/1.1" 200 None
2026-03-27 11:32:53 [auto1.be] INFO: Scrape type for RY67713: 0
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: LB43860
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB43860%27 HTTP/1.1" 200 None
2026-03-27 11:32:53 [auto1.be] INFO: Scrape type for LB43860: 0
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: LT43988
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT43988%27 HTTP/1.1" 200 None
2026-03-27 11:32:53 [auto1.be] INFO: Scrape type for LT43988: 0
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: JC58807
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: JT22008
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT22008%27 HTTP/1.1" 200 None
2026-03-27 11:32:53 [auto1.be] INFO: Scrape type for JT22008: 0
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: SX01610
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX01610%27 HTTP/1.1" 200 None
2026-03-27 11:32:53 [auto1.be] INFO: Scrape type for SX01610: 0
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: XR56379
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR56379%27 HTTP/1.1" 200 None
2026-03-27 11:32:53 [auto1.be] INFO: Scrape type for XR56379: 0
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: UA15007
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: JU85415
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU85415%27 HTTP/1.1" 200 None
2026-03-27 11:32:53 [auto1.be] INFO: Scrape type for JU85415: 0
2026-03-27 11:32:53 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-27 11:32:53 [auto1.be] INFO: Scrape type for DL13581: 0
2026-03-27 11:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:54 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:54 [auto1.be] INFO: Found listing with ID: PC72371
2026-03-27 11:32:54 [auto1.be] INFO: Found listing with ID: YX77008
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX77008%27 HTTP/1.1" 200 None
2026-03-27 11:32:54 [auto1.be] INFO: Scrape type for YX77008: 0
2026-03-27 11:32:54 [auto1.be] INFO: Found listing with ID: ET01802
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET01802%27 HTTP/1.1" 200 None
2026-03-27 11:32:54 [auto1.be] INFO: Scrape type for ET01802: 0
2026-03-27 11:32:54 [auto1.be] INFO: Found listing with ID: YZ45522
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ45522%27 HTTP/1.1" 200 None
2026-03-27 11:32:54 [auto1.be] INFO: Scrape type for YZ45522: 0
2026-03-27 11:32:54 [auto1.be] INFO: Found listing with ID: ED62480
2026-03-27 11:32:54 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB29078%27 HTTP/1.1" 200 None
2026-03-27 11:32:54 [auto1.be] INFO: Scrape type for NB29078: 0
2026-03-27 11:32:54 [auto1.be] INFO: Found listing with ID: SK00862
2026-03-27 11:32:54 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-27 11:32:54 [auto1.be] INFO: Found listing with ID: PU00884
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU00884%27 HTTP/1.1" 200 None
2026-03-27 11:32:54 [auto1.be] INFO: Scrape type for PU00884: 0
2026-03-27 11:32:54 [auto1.be] INFO: Found listing with ID: CN66713
2026-03-27 11:32:54 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-27 11:32:54 [auto1.be] INFO: Scrape type for AK54797: 0
2026-03-27 11:32:54 [auto1.be] INFO: Found listing with ID: CB83529
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB83529%27 HTTP/1.1" 200 None
2026-03-27 11:32:54 [auto1.be] INFO: Scrape type for CB83529: 0
2026-03-27 11:32:54 [auto1.be] INFO: Found listing with ID: XC37877
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC37877%27 HTTP/1.1" 200 None
2026-03-27 11:32:54 [auto1.be] INFO: Scrape type for XC37877: 2
2026-03-27 11:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 095b87b4-253d-5c13-a9f1-dfd6f02c7484 with identifier: XC37877
2026-03-27 11:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 095b87b4-253d-5c13-a9f1-dfd6f02c7484 with scrape type 2
2026-03-27 11:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 095b87b4-253d-5c13-a9f1-dfd6f02c7484 with scrape type 2
2026-03-27 11:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 095b87b4-253d-5c13-a9f1-dfd6f02c7484, identifier: XC37877
2026-03-27 11:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 095b87b4-253d-5c13-a9f1-dfd6f02c7484 with identifier: XC37877
2026-03-27 11:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 095b87b4-253d-5c13-a9f1-dfd6f02c7484 with identifier: XC37877
2026-03-27 11:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 095b87b4-253d-5c13-a9f1-dfd6f02c7484 with identifier: XC37877 to the API
2026-03-27 11:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:11:35Z',
 'fuel_type': 'diesel',
 'id': '095b87b4-253d-5c13-a9f1-dfd6f02c7484',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC37877',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 210068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-28',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi Energy Grand Confort L2H1 1200',
 'transmission': 'manual',
 'trim': 'Grand Confort L2H1 1200',
 'year': 2015}
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC37877%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Saving data for XC37877: {'auction_closing_time': 1774627895.0, 'created_time': 1774341037.924664, 'last_price_update_time': 1774611176.160895}
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC37877') HTTP/1.1" 204 0
2026-03-27 11:32:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: BP55098
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: ZY53321
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: KR32592
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR32592%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Scrape type for KR32592: 2
2026-03-27 11:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with identifier: KR32592
2026-03-27 11:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with scrape type 2
2026-03-27 11:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with scrape type 2
2026-03-27 11:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 703f2f46-f56c-59ff-96af-31a1c1f2ea69, identifier: KR32592
2026-03-27 11:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with identifier: KR32592
2026-03-27 11:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with identifier: KR32592
2026-03-27 11:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with identifier: KR32592 to the API
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:44:12Z',
 'fuel_type': 'diesel',
 'id': '703f2f46-f56c-59ff-96af-31a1c1f2ea69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR32592',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 191574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-05',
 'seller_name': None,
 'title': 'Opel Meriva 1.3 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR32592%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Saving data for KR32592: {'auction_closing_time': 1774629852.0, 'created_time': 1773834369.162697, 'last_price_update_time': 1774611176.76891}
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KR32592') HTTP/1.1" 204 0
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: MS95161
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS95161%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Scrape type for MS95161: 0
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: MR56300
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR56300%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Scrape type for MR56300: 0
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: NH29158
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: LR81556
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: GN30900
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN30900%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Scrape type for GN30900: 0
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: JZ31869
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: EP73132
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: ZY41289
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY41289%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Scrape type for ZY41289: 0
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: CP91867
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91867%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Scrape type for CP91867: 0
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: CF18791
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF18791%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Scrape type for CF18791: 0
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: VW96598
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: AE79510
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: JL40552
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: HE73926
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: PF50688
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF50688%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Scrape type for PF50688: 0
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: FS22519
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS22519%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Scrape type for FS22519: 0
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: BR84534
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: CM71971
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM71971%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Scrape type for CM71971: 0
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: FN85059
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: VY02593
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY02593%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Scrape type for VY02593: 0
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: TA14321
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: HJ60964
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: SD62634
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD62634%27 HTTP/1.1" 200 None
2026-03-27 11:32:56 [auto1.be] INFO: Scrape type for SD62634: 0
2026-03-27 11:32:56 [auto1.be] INFO: Found listing with ID: PW65130
2026-03-27 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW65130%27 HTTP/1.1" 200 None
2026-03-27 11:32:57 [auto1.be] INFO: Scrape type for PW65130: 2
2026-03-27 11:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c412b5f-5076-55fd-9395-437759599ac5 with identifier: PW65130
2026-03-27 11:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c412b5f-5076-55fd-9395-437759599ac5 with scrape type 2
2026-03-27 11:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c412b5f-5076-55fd-9395-437759599ac5 with scrape type 2
2026-03-27 11:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c412b5f-5076-55fd-9395-437759599ac5, identifier: PW65130
2026-03-27 11:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c412b5f-5076-55fd-9395-437759599ac5 with identifier: PW65130
2026-03-27 11:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c412b5f-5076-55fd-9395-437759599ac5 with identifier: PW65130
2026-03-27 11:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c412b5f-5076-55fd-9395-437759599ac5 with identifier: PW65130 to the API
2026-03-27 11:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-27T16:49:11Z',
 'fuel_type': 'diesel',
 'id': '1c412b5f-5076-55fd-9395-437759599ac5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW65130',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 191520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 Blue-HDi 335 L3H2 Asphalt Stop&Start',
 'transmission': 'manual',
 'trim': '335 L3H2 Asphalt Stop&Start',
 'year': 2020}
2026-03-27 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW65130%27 HTTP/1.1" 200 None
2026-03-27 11:32:57 [auto1.be] INFO: Saving data for PW65130: {'auction_closing_time': 1774630151.0, 'created_time': 1773237402.699445, 'last_price_update_time': 1774611177.445508}
2026-03-27 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PW65130') HTTP/1.1" 204 0
2026-03-27 11:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:58 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1866 | hits on page: 40
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: AR12045
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: BY03861
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY03861%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for BY03861: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: TV03405
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: YJ37534
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: VK27252
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: ER60484
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER60484%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for ER60484: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: WS17719
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS17719%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for WS17719: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: RN01918
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: CY42918
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY42918%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for CY42918: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: DS89988
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: BX14105
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: YC56497
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: SP19111
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for FT96499: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: RF85540
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF85540%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for RF85540: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: SY57103
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: MW20724
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW20724%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for MW20724: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: YD10614
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD10614%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for YD10614: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: RK47146
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK47146%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for RK47146: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for DH21315: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: RT59839
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RT59839%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for RT59839: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: MN62263
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: HS04385
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for KG19380: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: BJ47720
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ47720%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for BJ47720: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: GH90651
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: RB21597
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: MX18296
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: JE21822
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE21822%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for JE21822: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: MD01778
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD01778%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for MD01778: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD69002%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for SD69002: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: KZ42002
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ42002%27 HTTP/1.1" 200 None
2026-03-27 11:32:58 [auto1.be] INFO: Scrape type for KZ42002: 0
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-27 11:32:58 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-27 11:32:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:32:59 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1867 | hits on page: 40
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: XK31036
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: CX55361
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: GM39881
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-27 11:32:59 [auto1.be] INFO: Scrape type for VH38978: 0
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: VN59919
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: YF40273
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: TT89669
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT89669%27 HTTP/1.1" 200 None
2026-03-27 11:32:59 [auto1.be] INFO: Scrape type for TT89669: 0
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH79590%27 HTTP/1.1" 200 None
2026-03-27 11:32:59 [auto1.be] INFO: Scrape type for DH79590: 0
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: MH02888
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: FE12060
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: DK31159
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: YK88135
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: BP92313
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: MJ84457
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ84457%27 HTTP/1.1" 200 None
2026-03-27 11:32:59 [auto1.be] INFO: Scrape type for MJ84457: 0
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: TU22129
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU22129%27 HTTP/1.1" 200 None
2026-03-27 11:32:59 [auto1.be] INFO: Scrape type for TU22129: 0
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: TL97420
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: WG15817
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG15817%27 HTTP/1.1" 200 None
2026-03-27 11:32:59 [auto1.be] INFO: Scrape type for WG15817: 0
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: BL91672
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: KH42245
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH42245%27 HTTP/1.1" 200 None
2026-03-27 11:32:59 [auto1.be] INFO: Scrape type for KH42245: 0
2026-03-27 11:32:59 [auto1.be] INFO: Found listing with ID: TH56749
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH56749%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Scrape type for TH56749: 0
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: LB55394
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: EN96756
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN96756%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Scrape type for EN96756: 0
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ53898%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Scrape type for TZ53898: 0
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: GZ41273
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GZ41273%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Scrape type for GZ41273: 0
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: PT93863
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Scrape type for WU67286: 0
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: BL25220
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: FG30090
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG30090%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Scrape type for FG30090: 0
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: WG96246
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: YK49914
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: PY47802
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY47802%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Scrape type for PY47802: 0
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: VP39360
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP39360%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Scrape type for VP39360: 0
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: PM51414
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM51414%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Scrape type for PM51414: 0
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: YW10235
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW10235%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Scrape type for YW10235: 0
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: CY95631
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY95631%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Scrape type for CY95631: 0
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: CE16850
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE16850%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Scrape type for CE16850: 0
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: CA69556
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA69556%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Scrape type for CA69556: 2
2026-03-27 11:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 822fc206-b0f4-515e-8e77-a30e0cb853f6 with identifier: CA69556
2026-03-27 11:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 822fc206-b0f4-515e-8e77-a30e0cb853f6 with scrape type 2
2026-03-27 11:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 822fc206-b0f4-515e-8e77-a30e0cb853f6 with scrape type 2
2026-03-27 11:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 822fc206-b0f4-515e-8e77-a30e0cb853f6, identifier: CA69556
2026-03-27 11:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 822fc206-b0f4-515e-8e77-a30e0cb853f6 with identifier: CA69556
2026-03-27 11:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 822fc206-b0f4-515e-8e77-a30e0cb853f6 with identifier: CA69556
2026-03-27 11:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 822fc206-b0f4-515e-8e77-a30e0cb853f6 with identifier: CA69556 to the API
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:28:51Z',
 'fuel_type': 'diesel',
 'id': '822fc206-b0f4-515e-8e77-a30e0cb853f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA69556',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 136183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-08',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2019}
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA69556%27 HTTP/1.1" 200 None
2026-03-27 11:33:00 [auto1.be] INFO: Saving data for CA69556: {'auction_closing_time': 1774628931.0, 'created_time': 1774427452.405233, 'last_price_update_time': 1774611180.764678}
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CA69556') HTTP/1.1" 204 0
2026-03-27 11:33:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:00 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-27 11:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:02 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1867 | hits on page: 40
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: UZ89311
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ89311%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for UZ89311: 0
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: WU68692
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU68692%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for WU68692: 0
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: ZW60968
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW60968%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for ZW60968: 0
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: WE56868
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: GS77634
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: NK66135
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK66135%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for NK66135: 0
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: LW97961
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: FB96864
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB96864%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for FB96864: 0
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: UT11356
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT11356%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for UT11356: 0
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: AN88473
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: WM04109
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM04109%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for WM04109: 0
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: KN27020
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: DF46667
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: FB06162
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: UE29178
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE29178%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for UE29178: 0
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: CL62340
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CL62340%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for CL62340: 0
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: GN83226
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: ZY04103
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: TB39644
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: NF55706
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NF55706%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for NF55706: 0
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for CS08088: 0
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: EU07402
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU07402%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for EU07402: 0
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: WA40549
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA40549%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for WA40549: 0
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: UY34389
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY34389%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for UY34389: 2
2026-03-27 11:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe6ab7c3-de2c-57aa-999a-264c4f2157d3 with identifier: UY34389
2026-03-27 11:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe6ab7c3-de2c-57aa-999a-264c4f2157d3 with scrape type 2
2026-03-27 11:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe6ab7c3-de2c-57aa-999a-264c4f2157d3 with scrape type 2
2026-03-27 11:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fe6ab7c3-de2c-57aa-999a-264c4f2157d3, identifier: UY34389
2026-03-27 11:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fe6ab7c3-de2c-57aa-999a-264c4f2157d3 with identifier: UY34389
2026-03-27 11:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fe6ab7c3-de2c-57aa-999a-264c4f2157d3 with identifier: UY34389
2026-03-27 11:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fe6ab7c3-de2c-57aa-999a-264c4f2157d3 with identifier: UY34389 to the API
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:56:19Z',
 'fuel_type': 'petrol',
 'id': 'fe6ab7c3-de2c-57aa-999a-264c4f2157d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY34389',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 66441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-14',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Progression',
 'transmission': 'manual',
 'trim': 'Progression',
 'year': 2014}
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY34389%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Saving data for UY34389: {'auction_closing_time': 1774630579.0, 'created_time': 1774038656.957246, 'last_price_update_time': 1774611182.676757}
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY34389') HTTP/1.1" 204 0
2026-03-27 11:33:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:02 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR41774%27 HTTP/1.1" 200 None
2026-03-27 11:33:02 [auto1.be] INFO: Scrape type for WR41774: 2
2026-03-27 11:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6 with identifier: WR41774
2026-03-27 11:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6 with scrape type 2
2026-03-27 11:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6 with scrape type 2
2026-03-27 11:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6, identifier: WR41774
2026-03-27 11:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6 with identifier: WR41774
2026-03-27 11:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6 with identifier: WR41774
2026-03-27 11:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6 with identifier: WR41774 to the API
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-27T16:04:35Z',
 'fuel_type': 'petrol',
 'id': '91ac3e24-e74d-5bf0-9755-018ff5cb1ea6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR41774',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 46213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-10',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR41774%27 HTTP/1.1" 200 None
2026-03-27 11:33:03 [auto1.be] INFO: Saving data for WR41774: {'auction_closing_time': 1774627475.0, 'created_time': 1773132634.93466, 'last_price_update_time': 1774611183.242843}
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WR41774') HTTP/1.1" 204 0
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: VV24394
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: JT01513
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: JA66364
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA66364%27 HTTP/1.1" 200 None
2026-03-27 11:33:03 [auto1.be] INFO: Scrape type for JA66364: 0
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: US70780
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US70780%27 HTTP/1.1" 200 None
2026-03-27 11:33:03 [auto1.be] INFO: Scrape type for US70780: 2
2026-03-27 11:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1e84b90-3b83-5c8d-bc38-419d7e35cc05 with identifier: US70780
2026-03-27 11:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1e84b90-3b83-5c8d-bc38-419d7e35cc05 with scrape type 2
2026-03-27 11:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1e84b90-3b83-5c8d-bc38-419d7e35cc05 with scrape type 2
2026-03-27 11:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c1e84b90-3b83-5c8d-bc38-419d7e35cc05, identifier: US70780
2026-03-27 11:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c1e84b90-3b83-5c8d-bc38-419d7e35cc05 with identifier: US70780
2026-03-27 11:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c1e84b90-3b83-5c8d-bc38-419d7e35cc05 with identifier: US70780
2026-03-27 11:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c1e84b90-3b83-5c8d-bc38-419d7e35cc05 with identifier: US70780 to the API
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:20:39Z',
 'fuel_type': 'petrol',
 'id': 'c1e84b90-3b83-5c8d-bc38-419d7e35cc05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US70780',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 185650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-04',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US70780%27 HTTP/1.1" 200 None
2026-03-27 11:33:03 [auto1.be] INFO: Saving data for US70780: {'auction_closing_time': 1774628439.0, 'created_time': 1774427452.771204, 'last_price_update_time': 1774611183.700216}
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='US70780') HTTP/1.1" 204 0
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: KV15074
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: AT63193
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-27 11:33:03 [auto1.be] INFO: Scrape type for WA78577: 0
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: BM42306
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: SD94146
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD94146%27 HTTP/1.1" 200 None
2026-03-27 11:33:03 [auto1.be] INFO: Scrape type for SD94146: 0
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: KS18318
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: ZX75796
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: NP56862
2026-03-27 11:33:03 [auto1.be] INFO: Found listing with ID: LR06836
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR06836%27 HTTP/1.1" 200 None
2026-03-27 11:33:03 [auto1.be] INFO: Scrape type for LR06836: 0
2026-03-27 11:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:04 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1867 | hits on page: 40
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: JF05397
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: RK84429
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: GB32239
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB32239%27 HTTP/1.1" 200 None
2026-03-27 11:33:04 [auto1.be] INFO: Scrape type for GB32239: 0
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: CZ74735
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: KN58271
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: FN39801
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN39801%27 HTTP/1.1" 200 None
2026-03-27 11:33:04 [auto1.be] INFO: Scrape type for FN39801: 0
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: EC31925
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: CH84926
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: PZ75244
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ75244%27 HTTP/1.1" 200 None
2026-03-27 11:33:04 [auto1.be] INFO: Scrape type for PZ75244: 0
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: GE93003
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE93003%27 HTTP/1.1" 200 None
2026-03-27 11:33:04 [auto1.be] INFO: Scrape type for GE93003: 0
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: HD79839
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD79839%27 HTTP/1.1" 200 None
2026-03-27 11:33:04 [auto1.be] INFO: Scrape type for HD79839: 0
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-27 11:33:04 [auto1.be] INFO: Scrape type for HP15544: 0
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: XM85548
2026-03-27 11:33:04 [auto1.be] INFO: Found listing with ID: XF39050
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF39050%27 HTTP/1.1" 200 None
2026-03-27 11:33:04 [auto1.be] INFO: Scrape type for XF39050: 2
2026-03-27 11:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6ca39fc-1ba6-5f92-8022-3c11fe6c51f7 with identifier: XF39050
2026-03-27 11:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ca39fc-1ba6-5f92-8022-3c11fe6c51f7 with scrape type 2
2026-03-27 11:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6ca39fc-1ba6-5f92-8022-3c11fe6c51f7 with scrape type 2
2026-03-27 11:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a6ca39fc-1ba6-5f92-8022-3c11fe6c51f7, identifier: XF39050
2026-03-27 11:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a6ca39fc-1ba6-5f92-8022-3c11fe6c51f7 with identifier: XF39050
2026-03-27 11:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a6ca39fc-1ba6-5f92-8022-3c11fe6c51f7 with identifier: XF39050
2026-03-27 11:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a6ca39fc-1ba6-5f92-8022-3c11fe6c51f7 with identifier: XF39050 to the API
2026-03-27 11:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:03:56Z',
 'fuel_type': 'petrol',
 'id': 'a6ca39fc-1ba6-5f92-8022-3c11fe6c51f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF39050',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 178813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Lounge BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-27 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF39050%27 HTTP/1.1" 200 None
2026-03-27 11:33:05 [auto1.be] INFO: Saving data for XF39050: {'auction_closing_time': 1774627436.0, 'created_time': 1773224092.786455, 'last_price_update_time': 1774611185.965604}
2026-03-27 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XF39050') HTTP/1.1" 204 0
2026-03-27 11:33:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: HH31888
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH31888%27 HTTP/1.1" 200 None
2026-03-27 11:33:06 [auto1.be] INFO: Scrape type for HH31888: 0
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: SF36206
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-27 11:33:06 [auto1.be] INFO: Scrape type for KM93600: 0
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: KA89236
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: NB01852
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB01852%27 HTTP/1.1" 200 None
2026-03-27 11:33:06 [auto1.be] INFO: Scrape type for NB01852: 0
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: HV86645
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HV86645%27 HTTP/1.1" 200 None
2026-03-27 11:33:06 [auto1.be] INFO: Scrape type for HV86645: 0
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: NN61724
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN61724%27 HTTP/1.1" 200 None
2026-03-27 11:33:06 [auto1.be] INFO: Scrape type for NN61724: 0
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: HJ85146
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ85146%27 HTTP/1.1" 200 None
2026-03-27 11:33:06 [auto1.be] INFO: Scrape type for HJ85146: 0
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: FW68725
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW68725%27 HTTP/1.1" 200 None
2026-03-27 11:33:06 [auto1.be] INFO: Scrape type for FW68725: 0
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: FV70837
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: UC74238
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: XN63687
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: MU76581
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: XE83384
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: TK21885
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: XM70958
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM70958%27 HTTP/1.1" 200 None
2026-03-27 11:33:06 [auto1.be] INFO: Scrape type for XM70958: 0
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: LK47918
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: GU08447
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: MH45293
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: CY67407
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY67407%27 HTTP/1.1" 200 None
2026-03-27 11:33:06 [auto1.be] INFO: Scrape type for CY67407: 0
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: YN67239
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: AG26993
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG26993%27 HTTP/1.1" 200 None
2026-03-27 11:33:06 [auto1.be] INFO: Scrape type for AG26993: 2
2026-03-27 11:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be9d69e8-0d5b-5c9f-b806-4fc3530cff6f with identifier: AG26993
2026-03-27 11:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be9d69e8-0d5b-5c9f-b806-4fc3530cff6f with scrape type 2
2026-03-27 11:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be9d69e8-0d5b-5c9f-b806-4fc3530cff6f with scrape type 2
2026-03-27 11:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: be9d69e8-0d5b-5c9f-b806-4fc3530cff6f, identifier: AG26993
2026-03-27 11:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: be9d69e8-0d5b-5c9f-b806-4fc3530cff6f with identifier: AG26993
2026-03-27 11:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: be9d69e8-0d5b-5c9f-b806-4fc3530cff6f with identifier: AG26993
2026-03-27 11:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: be9d69e8-0d5b-5c9f-b806-4fc3530cff6f with identifier: AG26993 to the API
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-27T16:42:32Z',
 'fuel_type': 'diesel',
 'id': 'be9d69e8-0d5b-5c9f-b806-4fc3530cff6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG26993',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 215848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-12',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2017}
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG26993%27 HTTP/1.1" 200 None
2026-03-27 11:33:06 [auto1.be] INFO: Saving data for AG26993: {'auction_closing_time': 1774629752.0, 'created_time': 1773660886.808005, 'last_price_update_time': 1774611186.652149}
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AG26993') HTTP/1.1" 204 0
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: YC80318
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC80318%27 HTTP/1.1" 200 None
2026-03-27 11:33:06 [auto1.be] INFO: Scrape type for YC80318: 0
2026-03-27 11:33:06 [auto1.be] INFO: Found listing with ID: MD91238
2026-03-27 11:33:06 [scrapy.extensions.logstats] INFO: Crawled 147 pages (at 28 pages/min), scraped 175 items (at 51 items/min)
2026-03-27 11:33:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 187MiB
2026-03-27 11:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:07 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1867 | hits on page: 40
2026-03-27 11:33:07 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-27 11:33:07 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-27 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL40372%27 HTTP/1.1" 200 None
2026-03-27 11:33:07 [auto1.be] INFO: Scrape type for EL40372: 2
2026-03-27 11:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490f3616-d187-56ac-bcec-73dae31ca286 with identifier: EL40372
2026-03-27 11:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490f3616-d187-56ac-bcec-73dae31ca286 with scrape type 2
2026-03-27 11:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 490f3616-d187-56ac-bcec-73dae31ca286 with scrape type 2
2026-03-27 11:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 490f3616-d187-56ac-bcec-73dae31ca286, identifier: EL40372
2026-03-27 11:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 490f3616-d187-56ac-bcec-73dae31ca286 with identifier: EL40372
2026-03-27 11:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 490f3616-d187-56ac-bcec-73dae31ca286 with identifier: EL40372
2026-03-27 11:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 490f3616-d187-56ac-bcec-73dae31ca286 with identifier: EL40372 to the API
2026-03-27 11:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:12:28Z',
 'fuel_type': 'petrol',
 'id': '490f3616-d187-56ac-bcec-73dae31ca286',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL40372',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 131135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-26',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 160 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL40372%27 HTTP/1.1" 200 None
2026-03-27 11:33:08 [auto1.be] INFO: Saving data for EL40372: {'auction_closing_time': 1774627948.0, 'created_time': 1774427440.547331, 'last_price_update_time': 1774611188.530174}
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL40372') HTTP/1.1" 204 0
2026-03-27 11:33:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: JL90308
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL90308%27 HTTP/1.1" 200 None
2026-03-27 11:33:08 [auto1.be] INFO: Scrape type for JL90308: 0
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: VA39343
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: NP40379
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP40379%27 HTTP/1.1" 200 None
2026-03-27 11:33:08 [auto1.be] INFO: Scrape type for NP40379: 0
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: TE17554
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: YZ90167
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: FE77840
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE77840%27 HTTP/1.1" 200 None
2026-03-27 11:33:08 [auto1.be] INFO: Scrape type for FE77840: 0
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: BF87746
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF87746%27 HTTP/1.1" 200 None
2026-03-27 11:33:08 [auto1.be] INFO: Scrape type for BF87746: 0
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: PE40780
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE40780%27 HTTP/1.1" 200 None
2026-03-27 11:33:08 [auto1.be] INFO: Scrape type for PE40780: 0
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: DS76923
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS76923%27 HTTP/1.1" 200 None
2026-03-27 11:33:08 [auto1.be] INFO: Scrape type for DS76923: 0
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: JT80061
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: VR98111
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: MW35428
2026-03-27 11:33:08 [auto1.be] INFO: Found listing with ID: RK68495
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68495%27 HTTP/1.1" 200 None
2026-03-27 11:33:08 [auto1.be] INFO: Scrape type for RK68495: 2
2026-03-27 11:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c75d94d-f04d-505a-8710-a9433afeb7c3 with identifier: RK68495
2026-03-27 11:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c75d94d-f04d-505a-8710-a9433afeb7c3 with scrape type 2
2026-03-27 11:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c75d94d-f04d-505a-8710-a9433afeb7c3 with scrape type 2
2026-03-27 11:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3c75d94d-f04d-505a-8710-a9433afeb7c3, identifier: RK68495
2026-03-27 11:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3c75d94d-f04d-505a-8710-a9433afeb7c3 with identifier: RK68495
2026-03-27 11:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3c75d94d-f04d-505a-8710-a9433afeb7c3 with identifier: RK68495
2026-03-27 11:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3c75d94d-f04d-505a-8710-a9433afeb7c3 with identifier: RK68495 to the API
2026-03-27 11:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:18:26Z',
 'fuel_type': 'diesel',
 'id': '3c75d94d-f04d-505a-8710-a9433afeb7c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK68495',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 194313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-07',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2019}
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68495%27 HTTP/1.1" 200 None
2026-03-27 11:33:09 [auto1.be] INFO: Saving data for RK68495: {'auction_closing_time': 1774628306.0, 'created_time': 1774427442.654971, 'last_price_update_time': 1774611189.114267}
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK68495') HTTP/1.1" 204 0
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: WX63908
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: CW00167
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: UV85914
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: BY81514
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY81514%27 HTTP/1.1" 200 None
2026-03-27 11:33:09 [auto1.be] INFO: Scrape type for BY81514: 0
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: ML50952
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML50952%27 HTTP/1.1" 200 None
2026-03-27 11:33:09 [auto1.be] INFO: Scrape type for ML50952: 0
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: WM48145
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM48145%27 HTTP/1.1" 200 None
2026-03-27 11:33:09 [auto1.be] INFO: Scrape type for WM48145: 0
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: SH20992
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SH20992%27 HTTP/1.1" 200 None
2026-03-27 11:33:09 [auto1.be] INFO: Scrape type for SH20992: 0
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: TP87063
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: AA14466
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA14466%27 HTTP/1.1" 200 None
2026-03-27 11:33:09 [auto1.be] INFO: Scrape type for AA14466: 0
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: ER13199
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: SE01545
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: PR37992
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL86303%27 HTTP/1.1" 200 None
2026-03-27 11:33:09 [auto1.be] INFO: Scrape type for VL86303: 0
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: AD25511
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD25511%27 HTTP/1.1" 200 None
2026-03-27 11:33:09 [auto1.be] INFO: Scrape type for AD25511: 0
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: XG09867
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT02833%27 HTTP/1.1" 200 None
2026-03-27 11:33:09 [auto1.be] INFO: Scrape type for DT02833: 0
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: ZX19324
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX19324%27 HTTP/1.1" 200 None
2026-03-27 11:33:09 [auto1.be] INFO: Scrape type for ZX19324: 2
2026-03-27 11:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44140b5b-6bd8-58cc-9921-a4e7a60b11ac with identifier: ZX19324
2026-03-27 11:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44140b5b-6bd8-58cc-9921-a4e7a60b11ac with scrape type 2
2026-03-27 11:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44140b5b-6bd8-58cc-9921-a4e7a60b11ac with scrape type 2
2026-03-27 11:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 44140b5b-6bd8-58cc-9921-a4e7a60b11ac, identifier: ZX19324
2026-03-27 11:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 44140b5b-6bd8-58cc-9921-a4e7a60b11ac with identifier: ZX19324
2026-03-27 11:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 44140b5b-6bd8-58cc-9921-a4e7a60b11ac with identifier: ZX19324
2026-03-27 11:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 44140b5b-6bd8-58cc-9921-a4e7a60b11ac with identifier: ZX19324 to the API
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-27T16:16:59Z',
 'fuel_type': 'petrol',
 'id': '44140b5b-6bd8-58cc-9921-a4e7a60b11ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX19324',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 142663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 VTi Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2016}
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX19324%27 HTTP/1.1" 200 None
2026-03-27 11:33:09 [auto1.be] INFO: Saving data for ZX19324: {'auction_closing_time': 1774628219.0, 'created_time': 1774341055.235018, 'last_price_update_time': 1774611189.798378}
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX19324') HTTP/1.1" 204 0
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: WZ29783
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: XW87323
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XW87323%27 HTTP/1.1" 200 None
2026-03-27 11:33:09 [auto1.be] INFO: Scrape type for XW87323: 0
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: ZC53588
2026-03-27 11:33:09 [auto1.be] INFO: Found listing with ID: LV62557
2026-03-27 11:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:10 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1867 | hits on page: 40
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: JU90713
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU90713%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for JU90713: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: AS88658
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS88658%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for AS88658: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: XG51748
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG51748%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for XG51748: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: RA18682
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA18682%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for RA18682: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: HA43038
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA43038%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for HA43038: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: JD50267
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD50267%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for JD50267: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: GB24395
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: KD18952
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: GB16133
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB16133%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for GB16133: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: YK96520
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK96520%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for YK96520: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: VD47423
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD47423%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for VD47423: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: RY00106
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: BT18330
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: DR49981
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR49981%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for DR49981: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: DX33442
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX33442%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for DX33442: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: BP57356
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP57356%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for BP57356: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: XM22406
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM22406%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for XM22406: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: MS83423
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: GL39756
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL39756%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for GL39756: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: PC30370
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC30370%27 HTTP/1.1" 200 None
2026-03-27 11:33:10 [auto1.be] INFO: Scrape type for PC30370: 0
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: KW49487
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: WZ44020
2026-03-27 11:33:10 [auto1.be] INFO: Found listing with ID: ZG35997
2026-03-27 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG35997%27 HTTP/1.1" 200 None
2026-03-27 11:33:11 [auto1.be] INFO: Scrape type for ZG35997: 0
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: GE05105
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: PW03008
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: BZ33421
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: LK78865
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK78865%27 HTTP/1.1" 200 None
2026-03-27 11:33:11 [auto1.be] INFO: Scrape type for LK78865: 0
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: XZ87385
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: LD15814
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD15814%27 HTTP/1.1" 200 None
2026-03-27 11:33:11 [auto1.be] INFO: Scrape type for LD15814: 0
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: JZ19867
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ19867%27 HTTP/1.1" 200 None
2026-03-27 11:33:11 [auto1.be] INFO: Scrape type for JZ19867: 0
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: XM26582
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM26582%27 HTTP/1.1" 200 None
2026-03-27 11:33:11 [auto1.be] INFO: Scrape type for XM26582: 0
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: TH59922
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: CC33949
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC33949%27 HTTP/1.1" 200 None
2026-03-27 11:33:11 [auto1.be] INFO: Scrape type for CC33949: 2
2026-03-27 11:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b827d194-c07c-53f2-b6a0-f574c286a4dc with identifier: CC33949
2026-03-27 11:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b827d194-c07c-53f2-b6a0-f574c286a4dc with scrape type 2
2026-03-27 11:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b827d194-c07c-53f2-b6a0-f574c286a4dc with scrape type 2
2026-03-27 11:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b827d194-c07c-53f2-b6a0-f574c286a4dc, identifier: CC33949
2026-03-27 11:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b827d194-c07c-53f2-b6a0-f574c286a4dc with identifier: CC33949
2026-03-27 11:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b827d194-c07c-53f2-b6a0-f574c286a4dc with identifier: CC33949
2026-03-27 11:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b827d194-c07c-53f2-b6a0-f574c286a4dc with identifier: CC33949 to the API
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:54:01Z',
 'fuel_type': 'diesel',
 'id': 'b827d194-c07c-53f2-b6a0-f574c286a4dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC33949',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 193668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Classic',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Classic',
 'year': 2011}
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC33949%27 HTTP/1.1" 200 None
2026-03-27 11:33:11 [auto1.be] INFO: Saving data for CC33949: {'auction_closing_time': 1774630441.0, 'created_time': 1774006268.153584, 'last_price_update_time': 1774611191.515506}
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC33949') HTTP/1.1" 204 0
2026-03-27 11:33:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: CE58655
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58655%27 HTTP/1.1" 200 None
2026-03-27 11:33:11 [auto1.be] INFO: Scrape type for CE58655: 0
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: VF82058
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF82058%27 HTTP/1.1" 200 None
2026-03-27 11:33:11 [auto1.be] INFO: Scrape type for VF82058: 0
2026-03-27 11:33:11 [auto1.be] INFO: Found listing with ID: BE29252
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE29252%27 HTTP/1.1" 200 None
2026-03-27 11:33:11 [auto1.be] INFO: Scrape type for BE29252: 0
2026-03-27 11:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:28 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1867 | hits on page: 40
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: XP37575
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP37575%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for XP37575: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: GA94606
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA94606%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for GA94606: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW33850%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for WW33850: 2
2026-03-27 11:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89817c9e-19cb-5360-947c-47d8de676c21 with identifier: WW33850
2026-03-27 11:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89817c9e-19cb-5360-947c-47d8de676c21 with scrape type 2
2026-03-27 11:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89817c9e-19cb-5360-947c-47d8de676c21 with scrape type 2
2026-03-27 11:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 89817c9e-19cb-5360-947c-47d8de676c21, identifier: WW33850
2026-03-27 11:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 89817c9e-19cb-5360-947c-47d8de676c21 with identifier: WW33850
2026-03-27 11:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 89817c9e-19cb-5360-947c-47d8de676c21 with identifier: WW33850
2026-03-27 11:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 89817c9e-19cb-5360-947c-47d8de676c21 with identifier: WW33850 to the API
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:21:55Z',
 'fuel_type': 'diesel',
 'id': '89817c9e-19cb-5360-947c-47d8de676c21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW33850',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 147300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-18',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2014}
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW33850%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Saving data for WW33850: {'auction_closing_time': 1774628515.0, 'created_time': 1773136447.881673, 'last_price_update_time': 1774611208.629513}
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WW33850') HTTP/1.1" 204 0
2026-03-27 11:33:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: TT74487
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT74487%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for TT74487: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for BT72678: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for CS76215: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for JX04101: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: WV71876
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV71876%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for WV71876: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: HX14225
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for RM46702: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: RZ67143
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ67143%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for RZ67143: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for CS46585: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for TH79553: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for AP73624: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for CS46874: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for UV50609: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: YN50786
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: SF85634
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF85634%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for SF85634: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for RH88749: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for WK92284: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for KK24955: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for WA39171: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: PR67057
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR67057%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for PR67057: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: KJ95160
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-27 11:33:28 [auto1.be] INFO: Scrape type for XV14848: 0
2026-03-27 11:33:28 [auto1.be] INFO: Found listing with ID: JX70748
2026-03-27 11:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX70748%27 HTTP/1.1" 200 None
2026-03-27 11:33:29 [auto1.be] INFO: Scrape type for JX70748: 0
2026-03-27 11:33:29 [auto1.be] INFO: Found listing with ID: TP45390
2026-03-27 11:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP45390%27 HTTP/1.1" 200 None
2026-03-27 11:33:29 [auto1.be] INFO: Scrape type for TP45390: 0
2026-03-27 11:33:29 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-27 11:33:29 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-27 11:33:29 [auto1.be] INFO: Found listing with ID: TM05069
2026-03-27 11:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM05069%27 HTTP/1.1" 200 None
2026-03-27 11:33:29 [auto1.be] INFO: Scrape type for TM05069: 0
2026-03-27 11:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:30 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1867 | hits on page: 40
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: KV74957
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for MC94265: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: HZ06807
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ06807%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for HZ06807: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for WA10715: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: KS24234
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: ZD19958
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD19958%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for ZD19958: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: MA90783
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: MJ36288
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ36288%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for MJ36288: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: DH89229
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: GT47887
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT47887%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for GT47887: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: TL66022
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: HW94907
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW94907%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for HW94907: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: DD03061
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: LC64716
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC64716%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for LC64716: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: GC32489
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: SP46117
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: EA75507
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: GZ93190
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GZ93190%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for GZ93190: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: KS77192
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: UU18896
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: RG72901
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: TE96741
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: CU79953
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: VS83559
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS83559%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for VS83559: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: XF87645
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF87645%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for XF87645: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: ER31989
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER31989%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for ER31989: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: SP15752
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP15752%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for SP15752: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: VV37865
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV37865%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for VV37865: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: FW03307
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW03307%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for FW03307: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: WB15447
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB15447%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for WB15447: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: NL54460
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL54460%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for NL54460: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: PJ20069
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20069%27 HTTP/1.1" 200 None
2026-03-27 11:33:30 [auto1.be] INFO: Scrape type for PJ20069: 0
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: ZP04877
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: ML39304
2026-03-27 11:33:30 [auto1.be] INFO: Found listing with ID: TY45516
2026-03-27 11:33:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:40 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1868 | hits on page: 40
2026-03-27 11:33:40 [auto1.be] INFO: Found listing with ID: TY45516
2026-03-27 11:33:40 [auto1.be] INFO: Found listing with ID: XK92012
2026-03-27 11:33:40 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-27 11:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD75254%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for AD75254: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: ZB34516
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: TN24530
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TN24530%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for TN24530: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: ND54959
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND54959%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for ND54959: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: GW04237
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: VH69211
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH69211%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for VH69211: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: ZC59794
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC59794%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for ZC59794: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: XV99186
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: VC49251
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC49251%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for VC49251: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: BZ25768
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: XF87420
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: DC73649
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: PY65858
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: VN64438
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: NB36446
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: ZJ12375
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ12375%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for ZJ12375: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: SW89797
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: TG29223
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG29223%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for TG29223: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for RF74485: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: YB46987
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES45973%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for ES45973: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: LW64477
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: PM49627
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM49627%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for PM49627: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: ZA19942
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: RY00643
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: FF61873
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: GW03749
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW03749%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for GW03749: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: MR93085
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: ZK09193
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK09193%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for ZK09193: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: JD44636
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD44636%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for JD44636: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: TY52834
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52834%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for TY52834: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: CV18162
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV18162%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for CV18162: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: CF50288
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: YY56036
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: EA30540
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA30540%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for EA30540: 0
2026-03-27 11:33:41 [auto1.be] INFO: Found listing with ID: GA47341
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA47341%27 HTTP/1.1" 200 None
2026-03-27 11:33:41 [auto1.be] INFO: Scrape type for GA47341: 0
2026-03-27 11:33:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:42 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1868 | hits on page: 40
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: EP64027
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: SK61046
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK61046%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for SK61046: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: ES58711
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES58711%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for ES58711: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: NT61601
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT61601%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for NT61601: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: LZ66388
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ66388%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for LZ66388: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: WK59529
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK59529%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for WK59529: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: AG29104
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG29104%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for AG29104: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: PE56761
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE56761%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for PE56761: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: MN46567
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: GJ68786
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: JB31829
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: NP88880
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP88880%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for NP88880: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: RP97415
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: CL37184
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: SF61726
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF61726%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for SF61726: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for TH53375: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: TT28732
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT28732%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for TT28732: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: WB92078
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB92078%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for WB92078: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: VL25326
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: CX65783
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX65783%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for CX65783: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: WT70323
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT70323%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for WT70323: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: FU55171
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: XH46511
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH46511%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for XH46511: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: CK00600
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK00600%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for CK00600: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: ET54219
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET54219%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for ET54219: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: CE79076
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: SG10691
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: JK22182
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK22182%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for JK22182: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: VM59401
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM59401%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for VM59401: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: NX41996
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NX41996%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for NX41996: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: BT95259
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: XE29457
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE29457%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for XE29457: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: HX23250
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: TL08922
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: MN47281
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN47281%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for MN47281: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ74663%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for JZ74663: 0
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: UE04390
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-27 11:33:42 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS85102%27 HTTP/1.1" 200 None
2026-03-27 11:33:42 [auto1.be] INFO: Scrape type for XS85102: 0
2026-03-27 11:33:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:44 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1868 | hits on page: 40
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: AG93590
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: WU19263
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: ST88795
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: PZ32696
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: SD82427
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD82427%27 HTTP/1.1" 200 None
2026-03-27 11:33:44 [auto1.be] INFO: Scrape type for SD82427: 0
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: YL89644
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: PU20100
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: CR05374
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: LP05906
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: VN89668
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VN89668%27 HTTP/1.1" 200 None
2026-03-27 11:33:44 [auto1.be] INFO: Scrape type for VN89668: 0
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: KM82747
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: SD10160
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: HK73230
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: DK99913
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK99913%27 HTTP/1.1" 200 None
2026-03-27 11:33:44 [auto1.be] INFO: Scrape type for DK99913: 0
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: GY07088
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: AJ21944
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ21944%27 HTTP/1.1" 200 None
2026-03-27 11:33:44 [auto1.be] INFO: Scrape type for AJ21944: 0
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: WV34567
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: HF24600
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: CP32047
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: UJ17868
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ17868%27 HTTP/1.1" 200 None
2026-03-27 11:33:44 [auto1.be] INFO: Scrape type for UJ17868: 0
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: BE26093
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE26093%27 HTTP/1.1" 200 None
2026-03-27 11:33:44 [auto1.be] INFO: Scrape type for BE26093: 0
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: GG31991
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: RC95158
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC95158%27 HTTP/1.1" 200 None
2026-03-27 11:33:44 [auto1.be] INFO: Scrape type for RC95158: 0
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: SP85086
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: YS72178
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS72178%27 HTTP/1.1" 200 None
2026-03-27 11:33:44 [auto1.be] INFO: Scrape type for YS72178: 0
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: DX83468
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX83468%27 HTTP/1.1" 200 None
2026-03-27 11:33:44 [auto1.be] INFO: Scrape type for DX83468: 0
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: PU36315
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX71438%27 HTTP/1.1" 200 None
2026-03-27 11:33:44 [auto1.be] INFO: Scrape type for TX71438: 0
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: VF20080
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: RW00406
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW00406%27 HTTP/1.1" 200 None
2026-03-27 11:33:44 [auto1.be] INFO: Scrape type for RW00406: 0
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-27 11:33:44 [auto1.be] INFO: Scrape type for YS56392: 0
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-27 11:33:44 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-27 11:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:45 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1868 | hits on page: 40
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-27 11:33:45 [auto1.be] INFO: Scrape type for TT75307: 0
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-27 11:33:45 [auto1.be] INFO: Scrape type for GS48835: 0
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-27 11:33:45 [auto1.be] INFO: Scrape type for TS87931: 0
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: BZ82774
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: FM74317
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: AV10256
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV10256%27 HTTP/1.1" 200 None
2026-03-27 11:33:45 [auto1.be] INFO: Scrape type for AV10256: 0
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: JS12412
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-27 11:33:45 [auto1.be] INFO: Scrape type for YH98972: 0
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-27 11:33:45 [auto1.be] INFO: Scrape type for FP68376: 0
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-27 11:33:45 [auto1.be] INFO: Scrape type for MU18005: 0
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: AK05672
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-27 11:33:45 [auto1.be] INFO: Scrape type for RR89556: 0
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: FC68971
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC68971%27 HTTP/1.1" 200 None
2026-03-27 11:33:45 [auto1.be] INFO: Scrape type for FC68971: 0
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: XJ74253
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ74253%27 HTTP/1.1" 200 None
2026-03-27 11:33:45 [auto1.be] INFO: Scrape type for XJ74253: 0
2026-03-27 11:33:45 [auto1.be] INFO: Found listing with ID: EM04401
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM04401%27 HTTP/1.1" 200 None
2026-03-27 11:33:46 [auto1.be] INFO: Scrape type for EM04401: 0
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: FB17087
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB17087%27 HTTP/1.1" 200 None
2026-03-27 11:33:46 [auto1.be] INFO: Scrape type for FB17087: 0
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: SR94284
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: LN26575
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: CY75465
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY75465%27 HTTP/1.1" 200 None
2026-03-27 11:33:46 [auto1.be] INFO: Scrape type for CY75465: 0
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: MV45943
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV45943%27 HTTP/1.1" 200 None
2026-03-27 11:33:46 [auto1.be] INFO: Scrape type for MV45943: 0
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: DD53795
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: PW41553
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW41553%27 HTTP/1.1" 200 None
2026-03-27 11:33:46 [auto1.be] INFO: Scrape type for PW41553: 0
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: FX35985
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: MM41011
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM41011%27 HTTP/1.1" 200 None
2026-03-27 11:33:46 [auto1.be] INFO: Scrape type for MM41011: 0
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: RL87694
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL87694%27 HTTP/1.1" 200 None
2026-03-27 11:33:46 [auto1.be] INFO: Scrape type for RL87694: 0
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: YU37075
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU37075%27 HTTP/1.1" 200 None
2026-03-27 11:33:46 [auto1.be] INFO: Scrape type for YU37075: 0
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: FA46928
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: NT98623
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT98623%27 HTTP/1.1" 200 None
2026-03-27 11:33:46 [auto1.be] INFO: Scrape type for NT98623: 0
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: CV21559
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV21559%27 HTTP/1.1" 200 None
2026-03-27 11:33:46 [auto1.be] INFO: Scrape type for CV21559: 0
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: RW46644
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: ZC61300
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC61300%27 HTTP/1.1" 200 None
2026-03-27 11:33:46 [auto1.be] INFO: Scrape type for ZC61300: 0
2026-03-27 11:33:46 [auto1.be] INFO: Found listing with ID: XL78848
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL78848%27 HTTP/1.1" 200 None
2026-03-27 11:33:46 [auto1.be] INFO: Scrape type for XL78848: 0
2026-03-27 11:33:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:47 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1868 | hits on page: 40
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for PL61351: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: BR78441
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR78441%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for BR78441: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: FK60732
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK60732%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for FK60732: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: GH92132
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: YH64614
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH64614%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for YH64614: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: XF72387
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF72387%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for XF72387: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: GB86339
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB86339%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for GB86339: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: RD73499
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD73499%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for RD73499: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: CL98862
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CL98862%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for CL98862: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: ZP58534
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: FU67650
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU67650%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for FU67650: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: EY23386
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: EX87629
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: NC65783
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: EL96244
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL96244%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for EL96244: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: DF73363
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF73363%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for DF73363: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: WR10172
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: VN82922
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: PX01285
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: BU09612
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU09612%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for BU09612: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: YX87220
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX87220%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for YX87220: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: TD43625
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: BN85648
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN85648%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for BN85648: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: MT15926
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT15926%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for MT15926: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: SK78967
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK78967%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for SK78967: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: XM97787
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: WR97935
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: EM55936
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM55936%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for EM55936: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: TT36853
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: NA32288
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA32288%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for NA32288: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: XH06937
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH06937%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for XH06937: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: LW44669
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW44669%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for LW44669: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: ZE06900
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: MZ55081
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ55081%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for MZ55081: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: LA82396
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA82396%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for LA82396: 0
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: JY55769
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: RM94904
2026-03-27 11:33:47 [auto1.be] INFO: Found listing with ID: ZB61293
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB61293%27 HTTP/1.1" 200 None
2026-03-27 11:33:47 [auto1.be] INFO: Scrape type for ZB61293: 0
2026-03-27 11:33:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:49 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1868 | hits on page: 40
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: RP38047
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: EX12355
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX12355%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for EX12355: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: DF67918
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: EF17884
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: KH30418
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for YD21406: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for DF44974: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: SR19340
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for RK05604: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: UU59340
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for SD60477: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for FW88759: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: ZJ25058
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ25058%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for ZJ25058: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: CM55843
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM55843%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for CM55843: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: CX92013
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for XJ95743: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: GS88032
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS88032%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for GS88032: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: RE64899
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: CM09652
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for AJ68637: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: NM48533
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM48533%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for NM48533: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for XH41981: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for UR44884: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for CF04837: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: AB89489
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for LE69229: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: KK86800
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK86800%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for KK86800: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: KV92219
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for AX58227: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: CZ35254
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ35254%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for CZ35254: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for XC10139: 0
2026-03-27 11:33:49 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP75874%27 HTTP/1.1" 200 None
2026-03-27 11:33:49 [auto1.be] INFO: Scrape type for VP75874: 0
2026-03-27 11:33:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:50 [auto1.be] INFO: Channel: 24h | Page: 40 | totalHits: 1868 | hits on page: 40
2026-03-27 11:33:50 [auto1.be] INFO: Found listing with ID: YS24197
2026-03-27 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS24197%27 HTTP/1.1" 200 None
2026-03-27 11:33:50 [auto1.be] INFO: Scrape type for YS24197: 0
2026-03-27 11:33:50 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-27 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU54459%27 HTTP/1.1" 200 None
2026-03-27 11:33:50 [auto1.be] INFO: Scrape type for YU54459: 0
2026-03-27 11:33:50 [auto1.be] INFO: Found listing with ID: BF21618
2026-03-27 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF21618%27 HTTP/1.1" 200 None
2026-03-27 11:33:50 [auto1.be] INFO: Scrape type for BF21618: 0
2026-03-27 11:33:50 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-27 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-27 11:33:50 [auto1.be] INFO: Scrape type for CM40127: 0
2026-03-27 11:33:50 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-27 11:33:50 [auto1.be] INFO: Found listing with ID: BU16802
2026-03-27 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU16802%27 HTTP/1.1" 200 None
2026-03-27 11:33:50 [auto1.be] INFO: Scrape type for BU16802: 0
2026-03-27 11:33:50 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-27 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC05502%27 HTTP/1.1" 200 None
2026-03-27 11:33:50 [auto1.be] INFO: Scrape type for ZC05502: 0
2026-03-27 11:33:50 [auto1.be] INFO: Found listing with ID: MX12092
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX12092%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for MX12092: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for ZP07177: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: NK67799
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK67799%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for NK67799: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for WL68728: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for ZJ26609: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: TH69152
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: CU75749
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU75749%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for CU75749: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for ML85388: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for RL24593: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: RD19082
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for PE83293: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: YX66002
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX66002%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for YX66002: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: RZ51368
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: VG31015
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: EG27418
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG27418%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for EG27418: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: SL48266
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: FW44566
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: YB31848
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: VH72500
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH72500%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for VH72500: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for CN29269: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-27 11:33:51 [auto1.be] INFO: Scrape type for MN41841: 0
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: WG55963
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-27 11:33:51 [auto1.be] INFO: Found listing with ID: RB55358
2026-03-27 11:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:52 [auto1.be] INFO: Channel: 24h | Page: 41 | totalHits: 1868 | hits on page: 40
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-27 11:33:52 [auto1.be] INFO: Scrape type for HE95946: 0
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: HJ27727
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: UR73275
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR73275%27 HTTP/1.1" 200 None
2026-03-27 11:33:52 [auto1.be] INFO: Scrape type for UR73275: 0
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-27 11:33:52 [auto1.be] INFO: Scrape type for DS23322: 0
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: GS05656
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05656%27 HTTP/1.1" 200 None
2026-03-27 11:33:52 [auto1.be] INFO: Scrape type for GS05656: 0
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: NS72953
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: TC70277
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC70277%27 HTTP/1.1" 200 None
2026-03-27 11:33:52 [auto1.be] INFO: Scrape type for TC70277: 0
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-27 11:33:52 [auto1.be] INFO: Scrape type for DW61635: 0
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-27 11:33:52 [auto1.be] INFO: Scrape type for YG22909: 0
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: MS92273
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS92273%27 HTTP/1.1" 200 None
2026-03-27 11:33:52 [auto1.be] INFO: Scrape type for MS92273: 0
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: KM41856
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM41856%27 HTTP/1.1" 200 None
2026-03-27 11:33:52 [auto1.be] INFO: Scrape type for KM41856: 0
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-27 11:33:52 [auto1.be] INFO: Found listing with ID: AG09898
2026-03-27 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG09898%27 HTTP/1.1" 200 None
2026-03-27 11:33:53 [auto1.be] INFO: Scrape type for AG09898: 0
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-27 11:33:53 [auto1.be] INFO: Scrape type for RW15578: 0
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: CC60514
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC60514%27 HTTP/1.1" 200 None
2026-03-27 11:33:53 [auto1.be] INFO: Scrape type for CC60514: 0
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-27 11:33:53 [auto1.be] INFO: Scrape type for ZM46816: 0
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: AF35218
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-27 11:33:53 [auto1.be] INFO: Scrape type for RB53949: 0
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-27 11:33:53 [auto1.be] INFO: Scrape type for SE23508: 0
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-27 11:33:53 [auto1.be] INFO: Scrape type for KV94769: 0
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: UD97429
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97429%27 HTTP/1.1" 200 None
2026-03-27 11:33:53 [auto1.be] INFO: Scrape type for UD97429: 0
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: AX27110
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: BR44079
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-27 11:33:53 [auto1.be] INFO: Scrape type for BA13225: 0
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-27 11:33:53 [auto1.be] INFO: Scrape type for WC10504: 0
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-27 11:33:53 [auto1.be] INFO: Scrape type for UD97693: 0
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-27 11:33:53 [auto1.be] INFO: Scrape type for GR78986: 0
2026-03-27 11:33:53 [auto1.be] INFO: Found listing with ID: EM35888
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM35888%27 HTTP/1.1" 200 None
2026-03-27 11:33:53 [auto1.be] INFO: Scrape type for EM35888: 0
2026-03-27 11:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:54 [auto1.be] INFO: Channel: 24h | Page: 42 | totalHits: 1868 | hits on page: 40
2026-03-27 11:33:54 [auto1.be] INFO: Found listing with ID: WS64524
2026-03-27 11:33:54 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-27 11:33:54 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-27 11:33:54 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-27 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH74025%27 HTTP/1.1" 200 None
2026-03-27 11:33:54 [auto1.be] INFO: Scrape type for XH74025: 0
2026-03-27 11:33:54 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-27 11:33:54 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-27 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-27 11:33:54 [auto1.be] INFO: Scrape type for GX61337: 2
2026-03-27 11:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c606a4-debf-5aa0-bac1-8352f14136fc with identifier: GX61337
2026-03-27 11:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c606a4-debf-5aa0-bac1-8352f14136fc with scrape type 2
2026-03-27 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3c606a4-debf-5aa0-bac1-8352f14136fc with scrape type 2
2026-03-27 11:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b3c606a4-debf-5aa0-bac1-8352f14136fc, identifier: GX61337
2026-03-27 11:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b3c606a4-debf-5aa0-bac1-8352f14136fc with identifier: GX61337
2026-03-27 11:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b3c606a4-debf-5aa0-bac1-8352f14136fc with identifier: GX61337
2026-03-27 11:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b3c606a4-debf-5aa0-bac1-8352f14136fc with identifier: GX61337 to the API
2026-03-27 11:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:42:58Z',
 'fuel_type': 'petrol',
 'id': 'b3c606a4-debf-5aa0-bac1-8352f14136fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX61337',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 56740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-25',
 'seller_name': None,
 'title': 'Kia XCeed 1.0 TGDI Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2020}
2026-03-27 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-27 11:33:54 [auto1.be] INFO: Saving data for GX61337: {'auction_closing_time': 1774629778.0, 'created_time': 1774524670.979238, 'last_price_update_time': 1774611234.778}
2026-03-27 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GX61337') HTTP/1.1" 204 0
2026-03-27 11:33:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:54 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-27 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-27 11:33:54 [auto1.be] INFO: Scrape type for BK01349: 2
2026-03-27 11:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with identifier: BK01349
2026-03-27 11:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with scrape type 2
2026-03-27 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with scrape type 2
2026-03-27 11:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934, identifier: BK01349
2026-03-27 11:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with identifier: BK01349
2026-03-27 11:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with identifier: BK01349
2026-03-27 11:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with identifier: BK01349 to the API
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:11:03Z',
 'fuel_type': 'petrol',
 'id': 'f2ec4fbc-5d35-5fe3-b628-1228b4b3d934',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK01349',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 22103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Zen',
 'transmission': 'automatic',
 'trim': 'Zen',
 'year': 2022}
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-27 11:33:55 [auto1.be] INFO: Saving data for BK01349: {'auction_closing_time': 1774627863.0, 'created_time': 1774524676.159891, 'last_price_update_time': 1774611235.29333}
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BK01349') HTTP/1.1" 204 0
2026-03-27 11:33:55 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-27 11:33:55 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-27 11:33:55 [auto1.be] INFO: Scrape type for NG90127: 2
2026-03-27 11:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with identifier: NG90127
2026-03-27 11:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with scrape type 2
2026-03-27 11:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with scrape type 2
2026-03-27 11:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31, identifier: NG90127
2026-03-27 11:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with identifier: NG90127
2026-03-27 11:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with identifier: NG90127
2026-03-27 11:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with identifier: NG90127 to the API
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:42:46Z',
 'fuel_type': 'petrol',
 'id': '689d1450-c91a-59c5-8e6f-f4e9dbc68a31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG90127',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 134234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-27 11:33:55 [auto1.be] INFO: Saving data for NG90127: {'auction_closing_time': 1774629766.0, 'created_time': 1774524669.649977, 'last_price_update_time': 1774611235.685831}
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NG90127') HTTP/1.1" 204 0
2026-03-27 11:33:55 [auto1.be] INFO: Found listing with ID: SM52966
2026-03-27 11:33:55 [auto1.be] INFO: Found listing with ID: JW02809
2026-03-27 11:33:55 [auto1.be] INFO: Found listing with ID: CM13531
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM13531%27 HTTP/1.1" 200 None
2026-03-27 11:33:55 [auto1.be] INFO: Scrape type for CM13531: 2
2026-03-27 11:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aff15ca-070a-5a7e-9d83-81c923e3e6c3 with identifier: CM13531
2026-03-27 11:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aff15ca-070a-5a7e-9d83-81c923e3e6c3 with scrape type 2
2026-03-27 11:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1aff15ca-070a-5a7e-9d83-81c923e3e6c3 with scrape type 2
2026-03-27 11:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1aff15ca-070a-5a7e-9d83-81c923e3e6c3, identifier: CM13531
2026-03-27 11:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1aff15ca-070a-5a7e-9d83-81c923e3e6c3 with identifier: CM13531
2026-03-27 11:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1aff15ca-070a-5a7e-9d83-81c923e3e6c3 with identifier: CM13531
2026-03-27 11:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1aff15ca-070a-5a7e-9d83-81c923e3e6c3 with identifier: CM13531 to the API
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:37:01Z',
 'fuel_type': 'petrol',
 'id': '1aff15ca-070a-5a7e-9d83-81c923e3e6c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM13531',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 121865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-22',
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM13531%27 HTTP/1.1" 200 None
2026-03-27 11:33:56 [auto1.be] INFO: Saving data for CM13531: {'auction_closing_time': 1774629421.0, 'created_time': 1774524720.356846, 'last_price_update_time': 1774611236.074724}
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM13531') HTTP/1.1" 204 0
2026-03-27 11:33:56 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS12124%27 HTTP/1.1" 200 None
2026-03-27 11:33:56 [auto1.be] INFO: Scrape type for TS12124: 0
2026-03-27 11:33:56 [auto1.be] INFO: Found listing with ID: ZC13840
2026-03-27 11:33:56 [auto1.be] INFO: Found listing with ID: ZM96172
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM96172%27 HTTP/1.1" 200 None
2026-03-27 11:33:56 [auto1.be] INFO: Scrape type for ZM96172: 0
2026-03-27 11:33:56 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-27 11:33:56 [auto1.be] INFO: Scrape type for HH62001: 2
2026-03-27 11:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e159aa-dfa3-546b-af2c-2d385f022ff5 with identifier: HH62001
2026-03-27 11:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e159aa-dfa3-546b-af2c-2d385f022ff5 with scrape type 2
2026-03-27 11:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41e159aa-dfa3-546b-af2c-2d385f022ff5 with scrape type 2
2026-03-27 11:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41e159aa-dfa3-546b-af2c-2d385f022ff5, identifier: HH62001
2026-03-27 11:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41e159aa-dfa3-546b-af2c-2d385f022ff5 with identifier: HH62001
2026-03-27 11:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41e159aa-dfa3-546b-af2c-2d385f022ff5 with identifier: HH62001
2026-03-27 11:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41e159aa-dfa3-546b-af2c-2d385f022ff5 with identifier: HH62001 to the API
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-27T16:30:12Z',
 'fuel_type': 'petrol',
 'id': '41e159aa-dfa3-546b-af2c-2d385f022ff5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH62001',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 138606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-28',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 DSi Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2007}
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-27 11:33:56 [auto1.be] INFO: Saving data for HH62001: {'auction_closing_time': 1774629012.0, 'created_time': 1774524718.953296, 'last_price_update_time': 1774611236.471904}
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HH62001') HTTP/1.1" 204 0
2026-03-27 11:33:56 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-27 11:33:56 [auto1.be] INFO: Found listing with ID: PS35692
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS35692%27 HTTP/1.1" 200 None
2026-03-27 11:33:56 [auto1.be] INFO: Scrape type for PS35692: 0
2026-03-27 11:33:56 [auto1.be] INFO: Found listing with ID: WN30379
2026-03-27 11:33:56 [auto1.be] INFO: Found listing with ID: XY01493
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY01493%27 HTTP/1.1" 200 None
2026-03-27 11:33:56 [auto1.be] INFO: Scrape type for XY01493: 2
2026-03-27 11:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9bb3cae-ef01-5a68-be9b-bd46d8256b54 with identifier: XY01493
2026-03-27 11:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9bb3cae-ef01-5a68-be9b-bd46d8256b54 with scrape type 2
2026-03-27 11:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9bb3cae-ef01-5a68-be9b-bd46d8256b54 with scrape type 2
2026-03-27 11:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d9bb3cae-ef01-5a68-be9b-bd46d8256b54, identifier: XY01493
2026-03-27 11:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d9bb3cae-ef01-5a68-be9b-bd46d8256b54 with identifier: XY01493
2026-03-27 11:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d9bb3cae-ef01-5a68-be9b-bd46d8256b54 with identifier: XY01493
2026-03-27 11:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d9bb3cae-ef01-5a68-be9b-bd46d8256b54 with identifier: XY01493 to the API
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:16:13Z',
 'fuel_type': 'gas',
 'id': 'd9bb3cae-ef01-5a68-be9b-bd46d8256b54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY01493',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 63694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2022}
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY01493%27 HTTP/1.1" 200 None
2026-03-27 11:33:56 [auto1.be] INFO: Saving data for XY01493: {'auction_closing_time': 1774628173.0, 'created_time': 1774524714.213257, 'last_price_update_time': 1774611236.875373}
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XY01493') HTTP/1.1" 204 0
2026-03-27 11:33:56 [auto1.be] INFO: Found listing with ID: CJ31578
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CJ31578%27 HTTP/1.1" 200 None
2026-03-27 11:33:56 [auto1.be] INFO: Scrape type for CJ31578: 2
2026-03-27 11:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53657e6c-1023-5c32-9f2f-6bb99e2f99a5 with identifier: CJ31578
2026-03-27 11:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53657e6c-1023-5c32-9f2f-6bb99e2f99a5 with scrape type 2
2026-03-27 11:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53657e6c-1023-5c32-9f2f-6bb99e2f99a5 with scrape type 2
2026-03-27 11:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 53657e6c-1023-5c32-9f2f-6bb99e2f99a5, identifier: CJ31578
2026-03-27 11:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 53657e6c-1023-5c32-9f2f-6bb99e2f99a5 with identifier: CJ31578
2026-03-27 11:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 53657e6c-1023-5c32-9f2f-6bb99e2f99a5 with identifier: CJ31578
2026-03-27 11:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 53657e6c-1023-5c32-9f2f-6bb99e2f99a5 with identifier: CJ31578 to the API
2026-03-27 11:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:17:07Z',
 'fuel_type': 'petrol',
 'id': '53657e6c-1023-5c32-9f2f-6bb99e2f99a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ31578',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Veloster',
 'odometer': 120981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-16',
 'seller_name': None,
 'title': 'Hyundai Veloster 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-27 11:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CJ31578%27 HTTP/1.1" 200 None
2026-03-27 11:33:57 [auto1.be] INFO: Saving data for CJ31578: {'auction_closing_time': 1774628227.0, 'created_time': 1774524701.049221, 'last_price_update_time': 1774611237.345068}
2026-03-27 11:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CJ31578') HTTP/1.1" 204 0
2026-03-27 11:33:57 [auto1.be] INFO: Found listing with ID: YN58260
2026-03-27 11:33:57 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-27 11:33:57 [auto1.be] INFO: Found listing with ID: ZJ09914
2026-03-27 11:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ09914%27 HTTP/1.1" 200 None
2026-03-27 11:33:57 [auto1.be] INFO: Scrape type for ZJ09914: 2
2026-03-27 11:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64815f5-c46f-5ebd-b131-a7a71e0e2eca with identifier: ZJ09914
2026-03-27 11:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64815f5-c46f-5ebd-b131-a7a71e0e2eca with scrape type 2
2026-03-27 11:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64815f5-c46f-5ebd-b131-a7a71e0e2eca with scrape type 2
2026-03-27 11:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e64815f5-c46f-5ebd-b131-a7a71e0e2eca, identifier: ZJ09914
2026-03-27 11:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e64815f5-c46f-5ebd-b131-a7a71e0e2eca with identifier: ZJ09914
2026-03-27 11:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e64815f5-c46f-5ebd-b131-a7a71e0e2eca with identifier: ZJ09914
2026-03-27 11:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e64815f5-c46f-5ebd-b131-a7a71e0e2eca with identifier: ZJ09914 to the API
2026-03-27 11:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:59:07Z',
 'fuel_type': 'diesel',
 'id': 'e64815f5-c46f-5ebd-b131-a7a71e0e2eca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ09914',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-22',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2006}
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ09914%27 HTTP/1.1" 200 None
2026-03-27 11:33:58 [auto1.be] INFO: Saving data for ZJ09914: {'auction_closing_time': 1774630747.0, 'created_time': 1773233560.296452, 'last_price_update_time': 1774611238.165194}
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ09914') HTTP/1.1" 204 0
2026-03-27 11:33:58 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-27 11:33:58 [auto1.be] INFO: Scrape type for WE56106: 2
2026-03-27 11:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with identifier: WE56106
2026-03-27 11:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with scrape type 2
2026-03-27 11:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with scrape type 2
2026-03-27 11:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb, identifier: WE56106
2026-03-27 11:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with identifier: WE56106
2026-03-27 11:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with identifier: WE56106
2026-03-27 11:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with identifier: WE56106 to the API
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-27T16:27:10Z',
 'fuel_type': 'petrol',
 'id': '4a9af0a5-cad6-5f58-82c0-94270c54b4fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE56106',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 153607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-06',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-27 11:33:58 [auto1.be] INFO: Saving data for WE56106: {'auction_closing_time': 1774628830.0, 'created_time': 1774524712.791888, 'last_price_update_time': 1774611238.54237}
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WE56106') HTTP/1.1" 204 0
2026-03-27 11:33:58 [auto1.be] INFO: Found listing with ID: JH06099
2026-03-27 11:33:58 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-27 11:33:58 [auto1.be] INFO: Scrape type for TK06008: 2
2026-03-27 11:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7997474e-e482-5f20-a74c-54252a5a6170 with identifier: TK06008
2026-03-27 11:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7997474e-e482-5f20-a74c-54252a5a6170 with scrape type 2
2026-03-27 11:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7997474e-e482-5f20-a74c-54252a5a6170 with scrape type 2
2026-03-27 11:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7997474e-e482-5f20-a74c-54252a5a6170, identifier: TK06008
2026-03-27 11:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7997474e-e482-5f20-a74c-54252a5a6170 with identifier: TK06008
2026-03-27 11:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7997474e-e482-5f20-a74c-54252a5a6170 with identifier: TK06008
2026-03-27 11:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7997474e-e482-5f20-a74c-54252a5a6170 with identifier: TK06008 to the API
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-27T16:56:24Z',
 'fuel_type': 'petrol',
 'id': '7997474e-e482-5f20-a74c-54252a5a6170',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK06008',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 58001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-27 11:33:58 [auto1.be] INFO: Saving data for TK06008: {'auction_closing_time': 1774630584.0, 'created_time': 1774524708.334329, 'last_price_update_time': 1774611238.951033}
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TK06008') HTTP/1.1" 204 0
2026-03-27 11:33:58 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-27 11:33:58 [auto1.be] INFO: Scrape type for XZ27909: 2
2026-03-27 11:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with identifier: XZ27909
2026-03-27 11:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with scrape type 2
2026-03-27 11:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with scrape type 2
2026-03-27 11:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7, identifier: XZ27909
2026-03-27 11:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with identifier: XZ27909
2026-03-27 11:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with identifier: XZ27909
2026-03-27 11:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with identifier: XZ27909 to the API
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:24:33Z',
 'fuel_type': 'diesel',
 'id': '6ecffe6c-970f-5d77-8ddf-5349f842fdd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ27909',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 213426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-27 11:33:59 [auto1.be] INFO: Saving data for XZ27909: {'auction_closing_time': 1774628673.0, 'created_time': 1774524673.441385, 'last_price_update_time': 1774611239.334546}
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ27909') HTTP/1.1" 204 0
2026-03-27 11:33:59 [auto1.be] INFO: Channel: 24h | Page: 43 | totalHits: 1868 | hits on page: 40
2026-03-27 11:33:59 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-27 11:33:59 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-27 11:33:59 [auto1.be] INFO: Scrape type for XR84470: 2
2026-03-27 11:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with identifier: XR84470
2026-03-27 11:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with scrape type 2
2026-03-27 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with scrape type 2
2026-03-27 11:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b, identifier: XR84470
2026-03-27 11:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with identifier: XR84470
2026-03-27 11:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with identifier: XR84470
2026-03-27 11:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with identifier: XR84470 to the API
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-27T16:18:59Z',
 'fuel_type': 'petrol',
 'id': 'dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR84470',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Alto',
 'odometer': 162715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-12',
 'seller_name': None,
 'title': 'Suzuki Alto 1.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2009}
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-27 11:33:59 [auto1.be] INFO: Saving data for XR84470: {'auction_closing_time': 1774628339.0, 'created_time': 1774524703.352459, 'last_price_update_time': 1774611239.73013}
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XR84470') HTTP/1.1" 204 0
2026-03-27 11:33:59 [auto1.be] INFO: Found listing with ID: TT42662
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT42662%27 HTTP/1.1" 200 None
2026-03-27 11:33:59 [auto1.be] INFO: Scrape type for TT42662: 2
2026-03-27 11:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d825f9f2-5490-54f4-b73e-043df56f8af6 with identifier: TT42662
2026-03-27 11:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d825f9f2-5490-54f4-b73e-043df56f8af6 with scrape type 2
2026-03-27 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d825f9f2-5490-54f4-b73e-043df56f8af6 with scrape type 2
2026-03-27 11:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d825f9f2-5490-54f4-b73e-043df56f8af6, identifier: TT42662
2026-03-27 11:33:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:33:59 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-27 11:33:59 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-27 11:33:59 [auto1.be] INFO: Scrape type for UV91092: 2
2026-03-27 11:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with identifier: UV91092
2026-03-27 11:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with scrape type 2
2026-03-27 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with scrape type 2
2026-03-27 11:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 97cef536-caf7-59b1-ab3d-454ec74aa3a7, identifier: UV91092
2026-03-27 11:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d825f9f2-5490-54f4-b73e-043df56f8af6 with identifier: TT42662
2026-03-27 11:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d825f9f2-5490-54f4-b73e-043df56f8af6 with identifier: TT42662
2026-03-27 11:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d825f9f2-5490-54f4-b73e-043df56f8af6 with identifier: TT42662 to the API
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-27T16:33:31Z',
 'fuel_type': 'petrol',
 'id': 'd825f9f2-5490-54f4-b73e-043df56f8af6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT42662',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 74321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT42662%27 HTTP/1.1" 200 None
2026-03-27 11:34:00 [auto1.be] INFO: Saving data for TT42662: {'auction_closing_time': 1774629211.0, 'created_time': 1774524680.613911, 'last_price_update_time': 1774611240.246498}
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TT42662') HTTP/1.1" 204 0
2026-03-27 11:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with identifier: UV91092
2026-03-27 11:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with identifier: UV91092
2026-03-27 11:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with identifier: UV91092 to the API
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-27T16:17:59Z',
 'fuel_type': 'petrol',
 'id': '97cef536-caf7-59b1-ab3d-454ec74aa3a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV91092',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 13399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-24',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2021}
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-27 11:34:00 [auto1.be] INFO: Saving data for UV91092: {'auction_closing_time': 1774628279.0, 'created_time': 1774524703.749716, 'last_price_update_time': 1774611240.6128}
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UV91092') HTTP/1.1" 204 0
2026-03-27 11:34:00 [auto1.be] INFO: Found listing with ID: LD98603
2026-03-27 11:34:00 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-27 11:34:00 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-27 11:34:00 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-27 11:34:00 [auto1.be] INFO: Scrape type for FR80699: 2
2026-03-27 11:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 051c5500-5793-52b9-9ba2-05d30f6ce70a with identifier: FR80699
2026-03-27 11:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 051c5500-5793-52b9-9ba2-05d30f6ce70a with scrape type 2
2026-03-27 11:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 051c5500-5793-52b9-9ba2-05d30f6ce70a with scrape type 2
2026-03-27 11:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 051c5500-5793-52b9-9ba2-05d30f6ce70a, identifier: FR80699
2026-03-27 11:34:00 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW36552%27 HTTP/1.1" 200 None
2026-03-27 11:34:00 [auto1.be] INFO: Scrape type for CW36552: 2
2026-03-27 11:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a751ce71-7173-5c65-a126-aba3c2e73e8e with identifier: CW36552
2026-03-27 11:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a751ce71-7173-5c65-a126-aba3c2e73e8e with scrape type 2
2026-03-27 11:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a751ce71-7173-5c65-a126-aba3c2e73e8e with scrape type 2
2026-03-27 11:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a751ce71-7173-5c65-a126-aba3c2e73e8e, identifier: CW36552
2026-03-27 11:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 051c5500-5793-52b9-9ba2-05d30f6ce70a with identifier: FR80699
2026-03-27 11:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 051c5500-5793-52b9-9ba2-05d30f6ce70a with identifier: FR80699
2026-03-27 11:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 051c5500-5793-52b9-9ba2-05d30f6ce70a with identifier: FR80699 to the API
2026-03-27 11:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:11:57Z',
 'fuel_type': 'diesel',
 'id': '051c5500-5793-52b9-9ba2-05d30f6ce70a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR80699',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 166229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-27 11:34:01 [auto1.be] INFO: Saving data for FR80699: {'auction_closing_time': 1774627917.0, 'created_time': 1774524709.855569, 'last_price_update_time': 1774611241.161065}
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FR80699') HTTP/1.1" 204 0
2026-03-27 11:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a751ce71-7173-5c65-a126-aba3c2e73e8e with identifier: CW36552
2026-03-27 11:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a751ce71-7173-5c65-a126-aba3c2e73e8e with identifier: CW36552
2026-03-27 11:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a751ce71-7173-5c65-a126-aba3c2e73e8e with identifier: CW36552 to the API
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-27T16:08:38Z',
 'fuel_type': 'petrol',
 'id': 'a751ce71-7173-5c65-a126-aba3c2e73e8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW36552',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 199212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-15',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW36552%27 HTTP/1.1" 200 None
2026-03-27 11:34:01 [auto1.be] INFO: Saving data for CW36552: {'auction_closing_time': 1774627718.0, 'created_time': 1773136580.244709, 'last_price_update_time': 1774611241.452326}
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CW36552') HTTP/1.1" 204 0
2026-03-27 11:34:01 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-27 11:34:01 [auto1.be] INFO: Found listing with ID: WL76087
2026-03-27 11:34:01 [auto1.be] INFO: Found listing with ID: RZ94244
2026-03-27 11:34:01 [auto1.be] INFO: Found listing with ID: HY69206
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY69206%27 HTTP/1.1" 200 None
2026-03-27 11:34:01 [auto1.be] INFO: Scrape type for HY69206: 2
2026-03-27 11:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69d84a8f-14a4-5dbf-bd6a-dd77d04d6760 with identifier: HY69206
2026-03-27 11:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69d84a8f-14a4-5dbf-bd6a-dd77d04d6760 with scrape type 2
2026-03-27 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69d84a8f-14a4-5dbf-bd6a-dd77d04d6760 with scrape type 2
2026-03-27 11:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 69d84a8f-14a4-5dbf-bd6a-dd77d04d6760, identifier: HY69206
2026-03-27 11:34:01 [auto1.be] INFO: Found listing with ID: KE17510
2026-03-27 11:34:01 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-27 11:34:01 [auto1.be] INFO: Found listing with ID: ZR60411
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR60411%27 HTTP/1.1" 200 None
2026-03-27 11:34:01 [auto1.be] INFO: Scrape type for ZR60411: 2
2026-03-27 11:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0c43951-7cd1-5c70-8a9d-57bd80372c8c with identifier: ZR60411
2026-03-27 11:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c43951-7cd1-5c70-8a9d-57bd80372c8c with scrape type 2
2026-03-27 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0c43951-7cd1-5c70-8a9d-57bd80372c8c with scrape type 2
2026-03-27 11:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a0c43951-7cd1-5c70-8a9d-57bd80372c8c, identifier: ZR60411
2026-03-27 11:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 69d84a8f-14a4-5dbf-bd6a-dd77d04d6760 with identifier: HY69206
2026-03-27 11:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 69d84a8f-14a4-5dbf-bd6a-dd77d04d6760 with identifier: HY69206
2026-03-27 11:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 69d84a8f-14a4-5dbf-bd6a-dd77d04d6760 with identifier: HY69206 to the API
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:41:19Z',
 'fuel_type': 'diesel',
 'id': '69d84a8f-14a4-5dbf-bd6a-dd77d04d6760',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY69206',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 211151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-19',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Conceptline',
 'transmission': 'manual',
 'trim': 'Conceptline',
 'year': 2009}
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY69206%27 HTTP/1.1" 200 None
2026-03-27 11:34:01 [auto1.be] INFO: Saving data for HY69206: {'auction_closing_time': 1774629679.0, 'created_time': 1774524695.000381, 'last_price_update_time': 1774611241.940207}
2026-03-27 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY69206') HTTP/1.1" 204 0
2026-03-27 11:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a0c43951-7cd1-5c70-8a9d-57bd80372c8c with identifier: ZR60411
2026-03-27 11:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a0c43951-7cd1-5c70-8a9d-57bd80372c8c with identifier: ZR60411
2026-03-27 11:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a0c43951-7cd1-5c70-8a9d-57bd80372c8c with identifier: ZR60411 to the API
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-27T16:34:15Z',
 'fuel_type': 'hybrid',
 'id': 'a0c43951-7cd1-5c70-8a9d-57bd80372c8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR60411',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 73155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-20',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR60411%27 HTTP/1.1" 200 None
2026-03-27 11:34:02 [auto1.be] INFO: Saving data for ZR60411: {'auction_closing_time': 1774629255.0, 'created_time': 1774384486.157902, 'last_price_update_time': 1774611242.602033}
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR60411') HTTP/1.1" 204 0
2026-03-27 11:34:02 [auto1.be] INFO: Found listing with ID: TY40613
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY40613%27 HTTP/1.1" 200 None
2026-03-27 11:34:02 [auto1.be] INFO: Scrape type for TY40613: 0
2026-03-27 11:34:02 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-27 11:34:02 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-27 11:34:02 [auto1.be] INFO: Scrape type for TU47744: 2
2026-03-27 11:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7837f19-9d6b-58ca-ab26-796f67095cf9 with identifier: TU47744
2026-03-27 11:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7837f19-9d6b-58ca-ab26-796f67095cf9 with scrape type 2
2026-03-27 11:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7837f19-9d6b-58ca-ab26-796f67095cf9 with scrape type 2
2026-03-27 11:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7837f19-9d6b-58ca-ab26-796f67095cf9, identifier: TU47744
2026-03-27 11:34:02 [auto1.be] INFO: Found listing with ID: HT80651
2026-03-27 11:34:02 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-27 11:34:02 [auto1.be] INFO: Found listing with ID: YH39959
2026-03-27 11:34:02 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-27 11:34:02 [auto1.be] INFO: Scrape type for MA06269: 2
2026-03-27 11:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1a8844e-4c0a-5673-8d2a-4ca96307810d with identifier: MA06269
2026-03-27 11:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1a8844e-4c0a-5673-8d2a-4ca96307810d with scrape type 2
2026-03-27 11:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1a8844e-4c0a-5673-8d2a-4ca96307810d with scrape type 2
2026-03-27 11:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1a8844e-4c0a-5673-8d2a-4ca96307810d, identifier: MA06269
2026-03-27 11:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7837f19-9d6b-58ca-ab26-796f67095cf9 with identifier: TU47744
2026-03-27 11:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7837f19-9d6b-58ca-ab26-796f67095cf9 with identifier: TU47744
2026-03-27 11:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7837f19-9d6b-58ca-ab26-796f67095cf9 with identifier: TU47744 to the API
2026-03-27 11:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:04:16Z',
 'fuel_type': 'diesel',
 'id': 'b7837f19-9d6b-58ca-ab26-796f67095cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU47744',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 228161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-05',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 D-4D Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2013}
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-27 11:34:03 [auto1.be] INFO: Saving data for TU47744: {'auction_closing_time': 1774627456.0, 'created_time': 1774524684.965676, 'last_price_update_time': 1774611243.116503}
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU47744') HTTP/1.1" 204 0
2026-03-27 11:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1a8844e-4c0a-5673-8d2a-4ca96307810d with identifier: MA06269
2026-03-27 11:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1a8844e-4c0a-5673-8d2a-4ca96307810d with identifier: MA06269
2026-03-27 11:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1a8844e-4c0a-5673-8d2a-4ca96307810d with identifier: MA06269 to the API
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:31:43Z',
 'fuel_type': 'diesel',
 'id': 'a1a8844e-4c0a-5673-8d2a-4ca96307810d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA06269',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 157026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-18',
 'seller_name': None,
 'title': 'Peugeot 208 1.6 Blue-HDi Like',
 'transmission': 'manual',
 'trim': 'Like',
 'year': 2016}
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-27 11:34:03 [auto1.be] INFO: Saving data for MA06269: {'auction_closing_time': 1774629103.0, 'created_time': 1774524675.546347, 'last_price_update_time': 1774611243.379126}
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MA06269') HTTP/1.1" 204 0
2026-03-27 11:34:03 [auto1.be] INFO: Found listing with ID: JZ56411
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ56411%27 HTTP/1.1" 200 None
2026-03-27 11:34:03 [auto1.be] INFO: Scrape type for JZ56411: 2
2026-03-27 11:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e16baa0-a30f-5fc7-b13a-fb6ee8043cfe with identifier: JZ56411
2026-03-27 11:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e16baa0-a30f-5fc7-b13a-fb6ee8043cfe with scrape type 2
2026-03-27 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e16baa0-a30f-5fc7-b13a-fb6ee8043cfe with scrape type 2
2026-03-27 11:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e16baa0-a30f-5fc7-b13a-fb6ee8043cfe, identifier: JZ56411
2026-03-27 11:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e16baa0-a30f-5fc7-b13a-fb6ee8043cfe with identifier: JZ56411
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-27 11:34:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e16baa0-a30f-5fc7-b13a-fb6ee8043cfe with identifier: JZ56411
2026-03-27 11:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e16baa0-a30f-5fc7-b13a-fb6ee8043cfe with identifier: JZ56411 to the API
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-27T16:44:17Z',
 'fuel_type': 'petrol',
 'id': '2e16baa0-a30f-5fc7-b13a-fb6ee8043cfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ56411',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 84981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-20',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ56411%27 HTTP/1.1" 200 None
2026-03-27 11:34:03 [auto1.be] INFO: Saving data for JZ56411: {'auction_closing_time': 1774629857.0, 'created_time': 1773779913.255021, 'last_price_update_time': 1774611243.932616}
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ56411') HTTP/1.1" 204 0
2026-03-27 11:34:03 [auto1.be] INFO: Found listing with ID: GK19212
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK19212%27 HTTP/1.1" 200 None
2026-03-27 11:34:03 [auto1.be] INFO: Scrape type for GK19212: 2
2026-03-27 11:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b1df53b-3b19-53a6-9afd-b598fdd7899c with identifier: GK19212
2026-03-27 11:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b1df53b-3b19-53a6-9afd-b598fdd7899c with scrape type 2
2026-03-27 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b1df53b-3b19-53a6-9afd-b598fdd7899c with scrape type 2
2026-03-27 11:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2b1df53b-3b19-53a6-9afd-b598fdd7899c, identifier: GK19212
2026-03-27 11:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2b1df53b-3b19-53a6-9afd-b598fdd7899c with identifier: GK19212
2026-03-27 11:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2b1df53b-3b19-53a6-9afd-b598fdd7899c with identifier: GK19212
2026-03-27 11:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2b1df53b-3b19-53a6-9afd-b598fdd7899c with identifier: GK19212 to the API
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 349,
 'expiration_date': '2026-03-27T16:32:08Z',
 'fuel_type': 'hybrid',
 'id': '2b1df53b-3b19-53a6-9afd-b598fdd7899c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK19212',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 34724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-21',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T6 Recharge Plug-in Hybrid Plus Dark AWD',
 'transmission': 'automatic',
 'trim': 'Plus Dark AWD',
 'year': 2024}
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK19212%27 HTTP/1.1" 200 None
2026-03-27 11:34:04 [auto1.be] INFO: Saving data for GK19212: {'auction_closing_time': 1774629128.0, 'created_time': 1774524702.12785, 'last_price_update_time': 1774611244.316704}
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GK19212') HTTP/1.1" 204 0
2026-03-27 11:34:04 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-27 11:34:04 [auto1.be] INFO: Scrape type for NS73936: 2
2026-03-27 11:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with identifier: NS73936
2026-03-27 11:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with scrape type 2
2026-03-27 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with scrape type 2
2026-03-27 11:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127, identifier: NS73936
2026-03-27 11:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with identifier: NS73936
2026-03-27 11:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with identifier: NS73936
2026-03-27 11:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with identifier: NS73936 to the API
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:17:00Z',
 'fuel_type': 'petrol',
 'id': '8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS73936',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 58170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-30',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Mirror',
 'transmission': 'manual',
 'trim': 'Mirror',
 'year': 2017}
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-27 11:34:04 [auto1.be] INFO: Saving data for NS73936: {'auction_closing_time': 1774628220.0, 'created_time': 1774524682.966644, 'last_price_update_time': 1774611244.725231}
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NS73936') HTTP/1.1" 204 0
2026-03-27 11:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:34:04 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-27 11:34:04 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-27 11:34:04 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-27 11:34:04 [auto1.be] INFO: Scrape type for CS90165: 2
2026-03-27 11:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf424dce-9bd0-590b-8744-14f51e284260 with identifier: CS90165
2026-03-27 11:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf424dce-9bd0-590b-8744-14f51e284260 with scrape type 2
2026-03-27 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf424dce-9bd0-590b-8744-14f51e284260 with scrape type 2
2026-03-27 11:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf424dce-9bd0-590b-8744-14f51e284260, identifier: CS90165
2026-03-27 11:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf424dce-9bd0-590b-8744-14f51e284260 with identifier: CS90165
2026-03-27 11:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf424dce-9bd0-590b-8744-14f51e284260 with identifier: CS90165
2026-03-27 11:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf424dce-9bd0-590b-8744-14f51e284260 with identifier: CS90165 to the API
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:24:28Z',
 'fuel_type': 'diesel',
 'id': 'cf424dce-9bd0-590b-8744-14f51e284260',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS90165',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 241657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-07',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI clean diesel',
 'transmission': 'manual',
 'trim': 'clean diesel',
 'year': 2015}
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-27 11:34:05 [auto1.be] INFO: Saving data for CS90165: {'auction_closing_time': 1774628668.0, 'created_time': 1774524700.407624, 'last_price_update_time': 1774611245.098426}
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS90165') HTTP/1.1" 204 0
2026-03-27 11:34:05 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-27 11:34:05 [auto1.be] INFO: Found listing with ID: HF19605
2026-03-27 11:34:05 [auto1.be] INFO: Found listing with ID: MW21160
2026-03-27 11:34:05 [auto1.be] INFO: Found listing with ID: YJ74551
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ74551%27 HTTP/1.1" 200 None
2026-03-27 11:34:05 [auto1.be] INFO: Scrape type for YJ74551: 2
2026-03-27 11:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 297c93c2-def1-5152-8084-f2ccca34b5b9 with identifier: YJ74551
2026-03-27 11:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 297c93c2-def1-5152-8084-f2ccca34b5b9 with scrape type 2
2026-03-27 11:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 297c93c2-def1-5152-8084-f2ccca34b5b9 with scrape type 2
2026-03-27 11:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 297c93c2-def1-5152-8084-f2ccca34b5b9, identifier: YJ74551
2026-03-27 11:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 297c93c2-def1-5152-8084-f2ccca34b5b9 with identifier: YJ74551
2026-03-27 11:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 297c93c2-def1-5152-8084-f2ccca34b5b9 with identifier: YJ74551
2026-03-27 11:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 297c93c2-def1-5152-8084-f2ccca34b5b9 with identifier: YJ74551 to the API
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:57:34Z',
 'fuel_type': 'diesel',
 'id': '297c93c2-def1-5152-8084-f2ccca34b5b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ74551',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 119303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-03',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2013}
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ74551%27 HTTP/1.1" 200 None
2026-03-27 11:34:05 [auto1.be] INFO: Saving data for YJ74551: {'auction_closing_time': 1774630654.0, 'created_time': 1774524734.960451, 'last_price_update_time': 1774611245.561777}
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ74551') HTTP/1.1" 204 0
2026-03-27 11:34:05 [auto1.be] INFO: Channel: 24h | Page: 44 | totalHits: 1868 | hits on page: 40
2026-03-27 11:34:05 [auto1.be] INFO: Found listing with ID: EE72581
2026-03-27 11:34:05 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-27 11:34:05 [auto1.be] INFO: Scrape type for CH34151: 2
2026-03-27 11:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with identifier: CH34151
2026-03-27 11:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with scrape type 2
2026-03-27 11:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with scrape type 2
2026-03-27 11:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b, identifier: CH34151
2026-03-27 11:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with identifier: CH34151
2026-03-27 11:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with identifier: CH34151
2026-03-27 11:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with identifier: CH34151 to the API
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:13:59Z',
 'fuel_type': 'petrol',
 'id': '2f3ae0ec-f66b-5559-8522-f87fcf855c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH34151',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 57622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Skyactiv-G Mild-Hybrid Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2020}
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-27 11:34:05 [auto1.be] INFO: Saving data for CH34151: {'auction_closing_time': 1774628039.0, 'created_time': 1774524723.962299, 'last_price_update_time': 1774611245.946919}
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CH34151') HTTP/1.1" 204 0
2026-03-27 11:34:05 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-27 11:34:06 [auto1.be] INFO: Scrape type for RW49064: 2
2026-03-27 11:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bb20124-c7a5-5eb9-aeb0-897e67763536 with identifier: RW49064
2026-03-27 11:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bb20124-c7a5-5eb9-aeb0-897e67763536 with scrape type 2
2026-03-27 11:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bb20124-c7a5-5eb9-aeb0-897e67763536 with scrape type 2
2026-03-27 11:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0bb20124-c7a5-5eb9-aeb0-897e67763536, identifier: RW49064
2026-03-27 11:34:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:34:06 [auto1.be] INFO: Found listing with ID: SR57196
2026-03-27 11:34:06 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA83535%27 HTTP/1.1" 200 None
2026-03-27 11:34:06 [auto1.be] INFO: Scrape type for NA83535: 0
2026-03-27 11:34:06 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-27 11:34:06 [auto1.be] INFO: Scrape type for TW64249: 2
2026-03-27 11:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8a35451-5ed2-59ee-991e-149c10f05330 with identifier: TW64249
2026-03-27 11:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a35451-5ed2-59ee-991e-149c10f05330 with scrape type 2
2026-03-27 11:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8a35451-5ed2-59ee-991e-149c10f05330 with scrape type 2
2026-03-27 11:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c8a35451-5ed2-59ee-991e-149c10f05330, identifier: TW64249
2026-03-27 11:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0bb20124-c7a5-5eb9-aeb0-897e67763536 with identifier: RW49064
2026-03-27 11:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0bb20124-c7a5-5eb9-aeb0-897e67763536 with identifier: RW49064
2026-03-27 11:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0bb20124-c7a5-5eb9-aeb0-897e67763536 with identifier: RW49064 to the API
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-27T16:27:07Z',
 'fuel_type': 'diesel',
 'id': '0bb20124-c7a5-5eb9-aeb0-897e67763536',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW49064',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 191150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-14',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2018}
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-27 11:34:06 [auto1.be] INFO: Saving data for RW49064: {'auction_closing_time': 1774628827.0, 'created_time': 1774524698.63406, 'last_price_update_time': 1774611246.653183}
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW49064') HTTP/1.1" 204 0
2026-03-27 11:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c8a35451-5ed2-59ee-991e-149c10f05330 with identifier: TW64249
2026-03-27 11:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c8a35451-5ed2-59ee-991e-149c10f05330 with identifier: TW64249
2026-03-27 11:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c8a35451-5ed2-59ee-991e-149c10f05330 with identifier: TW64249 to the API
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-27T16:42:15Z',
 'fuel_type': 'petrol',
 'id': 'c8a35451-5ed2-59ee-991e-149c10f05330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW64249',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 56804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-05',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 2WD',
 'transmission': 'manual',
 'trim': '2WD',
 'year': 2019}
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-27 11:34:06 [auto1.be] INFO: Saving data for TW64249: {'auction_closing_time': 1774629735.0, 'created_time': 1774524735.748753, 'last_price_update_time': 1774611246.934004}
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TW64249') HTTP/1.1" 204 0
2026-03-27 11:34:06 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-27 11:34:06 [auto1.be] INFO: Scrape type for FY43318: 2
2026-03-27 11:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cca6974-2926-5b82-9783-98b83b9e5a21 with identifier: FY43318
2026-03-27 11:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cca6974-2926-5b82-9783-98b83b9e5a21 with scrape type 2
2026-03-27 11:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cca6974-2926-5b82-9783-98b83b9e5a21 with scrape type 2
2026-03-27 11:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0cca6974-2926-5b82-9783-98b83b9e5a21, identifier: FY43318
2026-03-27 11:34:07 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-27 11:34:07 [auto1.be] INFO: Scrape type for VA07887: 2
2026-03-27 11:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with identifier: VA07887
2026-03-27 11:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with scrape type 2
2026-03-27 11:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with scrape type 2
2026-03-27 11:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7, identifier: VA07887
2026-03-27 11:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0cca6974-2926-5b82-9783-98b83b9e5a21 with identifier: FY43318
2026-03-27 11:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0cca6974-2926-5b82-9783-98b83b9e5a21 with identifier: FY43318
2026-03-27 11:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0cca6974-2926-5b82-9783-98b83b9e5a21 with identifier: FY43318 to the API
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-27T16:46:14Z',
 'fuel_type': 'petrol',
 'id': '0cca6974-2926-5b82-9783-98b83b9e5a21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY43318',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 137116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-27 11:34:07 [auto1.be] INFO: Saving data for FY43318: {'auction_closing_time': 1774629974.0, 'created_time': 1774524688.848057, 'last_price_update_time': 1774611247.44514}
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FY43318') HTTP/1.1" 204 0
2026-03-27 11:34:07 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 15 pages/min), scraped 209 items (at 34 items/min)
2026-03-27 11:34:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 187MiB
2026-03-27 11:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with identifier: VA07887
2026-03-27 11:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with identifier: VA07887
2026-03-27 11:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with identifier: VA07887 to the API
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:52:36Z',
 'fuel_type': 'petrol',
 'id': '5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA07887',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 60381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-24',
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 TGDi Longitude 4x2',
 'transmission': 'automatic',
 'trim': 'Longitude 4x2',
 'year': 2020}
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-27 11:34:07 [auto1.be] INFO: Saving data for VA07887: {'auction_closing_time': 1774630356.0, 'created_time': 1774524717.848679, 'last_price_update_time': 1774611247.82984}
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA07887') HTTP/1.1" 204 0
2026-03-27 11:34:07 [auto1.be] INFO: Found listing with ID: MU03862
2026-03-27 11:34:07 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ68089%27 HTTP/1.1" 200 None
2026-03-27 11:34:07 [auto1.be] INFO: Scrape type for HJ68089: 0
2026-03-27 11:34:07 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-27 11:34:07 [auto1.be] INFO: Scrape type for SF38570: 2
2026-03-27 11:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46bfc384-0b14-5585-a127-339def39987c with identifier: SF38570
2026-03-27 11:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46bfc384-0b14-5585-a127-339def39987c with scrape type 2
2026-03-27 11:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46bfc384-0b14-5585-a127-339def39987c with scrape type 2
2026-03-27 11:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46bfc384-0b14-5585-a127-339def39987c, identifier: SF38570
2026-03-27 11:34:07 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-27 11:34:07 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-27 11:34:07 [auto1.be] INFO: Scrape type for TR87241: 2
2026-03-27 11:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 723da491-dff4-5725-97f1-c814e1c6991f with identifier: TR87241
2026-03-27 11:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 723da491-dff4-5725-97f1-c814e1c6991f with scrape type 2
2026-03-27 11:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 723da491-dff4-5725-97f1-c814e1c6991f with scrape type 2
2026-03-27 11:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 723da491-dff4-5725-97f1-c814e1c6991f, identifier: TR87241
2026-03-27 11:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46bfc384-0b14-5585-a127-339def39987c with identifier: SF38570
2026-03-27 11:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46bfc384-0b14-5585-a127-339def39987c with identifier: SF38570
2026-03-27 11:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46bfc384-0b14-5585-a127-339def39987c with identifier: SF38570 to the API
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:40:40Z',
 'fuel_type': 'diesel',
 'id': '46bfc384-0b14-5585-a127-339def39987c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF38570',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 196004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-16',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2011}
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-27 11:34:08 [auto1.be] INFO: Saving data for SF38570: {'auction_closing_time': 1774629640.0, 'created_time': 1774524728.099755, 'last_price_update_time': 1774611248.332828}
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SF38570') HTTP/1.1" 204 0
2026-03-27 11:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 723da491-dff4-5725-97f1-c814e1c6991f with identifier: TR87241
2026-03-27 11:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 723da491-dff4-5725-97f1-c814e1c6991f with identifier: TR87241
2026-03-27 11:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 723da491-dff4-5725-97f1-c814e1c6991f with identifier: TR87241 to the API
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:07:33Z',
 'fuel_type': 'diesel',
 'id': '723da491-dff4-5725-97f1-c814e1c6991f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR87241',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 131420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-03',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.5 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2019}
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-27 11:34:08 [auto1.be] INFO: Saving data for TR87241: {'auction_closing_time': 1774627653.0, 'created_time': 1774524714.970198, 'last_price_update_time': 1774611248.621748}
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TR87241') HTTP/1.1" 204 0
2026-03-27 11:34:08 [auto1.be] INFO: Found listing with ID: TD50799
2026-03-27 11:34:08 [auto1.be] INFO: Found listing with ID: ZB06103
2026-03-27 11:34:08 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-27 11:34:08 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-27 11:34:08 [auto1.be] INFO: Scrape type for JS25395: 2
2026-03-27 11:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c098b5-b634-51ba-b646-fa3203c26975 with identifier: JS25395
2026-03-27 11:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c098b5-b634-51ba-b646-fa3203c26975 with scrape type 2
2026-03-27 11:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96c098b5-b634-51ba-b646-fa3203c26975 with scrape type 2
2026-03-27 11:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96c098b5-b634-51ba-b646-fa3203c26975, identifier: JS25395
2026-03-27 11:34:08 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-27 11:34:08 [auto1.be] INFO: Scrape type for CN47453: 2
2026-03-27 11:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with identifier: CN47453
2026-03-27 11:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with scrape type 2
2026-03-27 11:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with scrape type 2
2026-03-27 11:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f, identifier: CN47453
2026-03-27 11:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96c098b5-b634-51ba-b646-fa3203c26975 with identifier: JS25395
2026-03-27 11:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96c098b5-b634-51ba-b646-fa3203c26975 with identifier: JS25395
2026-03-27 11:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96c098b5-b634-51ba-b646-fa3203c26975 with identifier: JS25395 to the API
2026-03-27 11:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:41:00Z',
 'fuel_type': 'diesel',
 'id': '96c098b5-b634-51ba-b646-fa3203c26975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS25395',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 91291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-24',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-27 11:34:09 [auto1.be] INFO: Saving data for JS25395: {'auction_closing_time': 1774629660.0, 'created_time': 1774524684.154196, 'last_price_update_time': 1774611249.150893}
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS25395') HTTP/1.1" 204 0
2026-03-27 11:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with identifier: CN47453
2026-03-27 11:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with identifier: CN47453
2026-03-27 11:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with identifier: CN47453 to the API
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:52:03Z',
 'fuel_type': 'diesel',
 'id': 'a86a3ac9-a42d-5c78-8c29-4ae09a1de77f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN47453',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 273890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'BMW 5er 520d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-27 11:34:09 [auto1.be] INFO: Saving data for CN47453: {'auction_closing_time': 1774630323.0, 'created_time': 1774524725.193731, 'last_price_update_time': 1774611249.437491}
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CN47453') HTTP/1.1" 204 0
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: FK67306
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX58483%27 HTTP/1.1" 200 None
2026-03-27 11:34:09 [auto1.be] INFO: Scrape type for ZX58483: 0
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: MG19472
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG19472%27 HTTP/1.1" 200 None
2026-03-27 11:34:09 [auto1.be] INFO: Scrape type for MG19472: 2
2026-03-27 11:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f6ad889-0634-5afe-b27d-134a6509604b with identifier: MG19472
2026-03-27 11:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f6ad889-0634-5afe-b27d-134a6509604b with scrape type 2
2026-03-27 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f6ad889-0634-5afe-b27d-134a6509604b with scrape type 2
2026-03-27 11:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4f6ad889-0634-5afe-b27d-134a6509604b, identifier: MG19472
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: PJ37303
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD78607%27 HTTP/1.1" 200 None
2026-03-27 11:34:09 [auto1.be] INFO: Scrape type for PD78607: 0
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: YN92139
2026-03-27 11:34:09 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-27 11:34:09 [auto1.be] INFO: Scrape type for LK16000: 2
2026-03-27 11:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6489067b-a958-52c0-b402-3218f78f1747 with identifier: LK16000
2026-03-27 11:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6489067b-a958-52c0-b402-3218f78f1747 with scrape type 2
2026-03-27 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6489067b-a958-52c0-b402-3218f78f1747 with scrape type 2
2026-03-27 11:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6489067b-a958-52c0-b402-3218f78f1747, identifier: LK16000
2026-03-27 11:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4f6ad889-0634-5afe-b27d-134a6509604b with identifier: MG19472
2026-03-27 11:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4f6ad889-0634-5afe-b27d-134a6509604b with identifier: MG19472
2026-03-27 11:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4f6ad889-0634-5afe-b27d-134a6509604b with identifier: MG19472 to the API
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:16:46Z',
 'fuel_type': 'petrol',
 'id': '4f6ad889-0634-5afe-b27d-134a6509604b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG19472',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 151599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-17',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Edition ecoFlex',
 'year': 2016}
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG19472%27 HTTP/1.1" 200 None
2026-03-27 11:34:09 [auto1.be] INFO: Saving data for MG19472: {'auction_closing_time': 1774628206.0, 'created_time': 1774524699.552726, 'last_price_update_time': 1774611249.985824}
2026-03-27 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MG19472') HTTP/1.1" 204 0
2026-03-27 11:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6489067b-a958-52c0-b402-3218f78f1747 with identifier: LK16000
2026-03-27 11:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6489067b-a958-52c0-b402-3218f78f1747 with identifier: LK16000
2026-03-27 11:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6489067b-a958-52c0-b402-3218f78f1747 with identifier: LK16000 to the API
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-27T16:55:41Z',
 'fuel_type': 'petrol',
 'id': '6489067b-a958-52c0-b402-3218f78f1747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK16000',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 94834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-07',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2013}
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-27 11:34:10 [auto1.be] INFO: Saving data for LK16000: {'auction_closing_time': 1774630541.0, 'created_time': 1774524696.871293, 'last_price_update_time': 1774611250.354622}
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK16000') HTTP/1.1" 204 0
2026-03-27 11:34:10 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-27 11:34:10 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-27 11:34:10 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-27 11:34:10 [auto1.be] INFO: Scrape type for GA09150: 2
2026-03-27 11:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with identifier: GA09150
2026-03-27 11:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with scrape type 2
2026-03-27 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with scrape type 2
2026-03-27 11:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474, identifier: GA09150
2026-03-27 11:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with identifier: GA09150
2026-03-27 11:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with identifier: GA09150
2026-03-27 11:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with identifier: GA09150 to the API
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-27T16:24:10Z',
 'fuel_type': 'diesel',
 'id': 'dcabeb84-ec6b-53b7-bcc8-18dd3bc04474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA09150',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 183696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-31',
 'seller_name': None,
 'title': 'BMW 3er 325d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-27 11:34:10 [auto1.be] INFO: Saving data for GA09150: {'auction_closing_time': 1774628650.0, 'created_time': 1774524690.959677, 'last_price_update_time': 1774611250.768873}
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GA09150') HTTP/1.1" 204 0
2026-03-27 11:34:10 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-27 11:34:10 [auto1.be] INFO: Found listing with ID: WG60858
2026-03-27 11:34:10 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-27 11:34:10 [auto1.be] INFO: Scrape type for LE58292: 2
2026-03-27 11:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88dec51-e319-5ca0-abb3-23e230e11298 with identifier: LE58292
2026-03-27 11:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88dec51-e319-5ca0-abb3-23e230e11298 with scrape type 2
2026-03-27 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88dec51-e319-5ca0-abb3-23e230e11298 with scrape type 2
2026-03-27 11:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e88dec51-e319-5ca0-abb3-23e230e11298, identifier: LE58292
2026-03-27 11:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e88dec51-e319-5ca0-abb3-23e230e11298 with identifier: LE58292
2026-03-27 11:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e88dec51-e319-5ca0-abb3-23e230e11298 with identifier: LE58292
2026-03-27 11:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e88dec51-e319-5ca0-abb3-23e230e11298 with identifier: LE58292 to the API
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:27:19Z',
 'fuel_type': 'diesel',
 'id': 'e88dec51-e319-5ca0-abb3-23e230e11298',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE58292',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 113628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-26',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-27 11:34:11 [auto1.be] INFO: Saving data for LE58292: {'auction_closing_time': 1774628839.0, 'created_time': 1774524704.281292, 'last_price_update_time': 1774611251.19419}
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE58292') HTTP/1.1" 204 0
2026-03-27 11:34:11 [auto1.be] INFO: Found listing with ID: MS10113
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS10113%27 HTTP/1.1" 200 None
2026-03-27 11:34:11 [auto1.be] INFO: Scrape type for MS10113: 2
2026-03-27 11:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f41c111c-f8e7-5809-862a-f2f05136463e with identifier: MS10113
2026-03-27 11:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f41c111c-f8e7-5809-862a-f2f05136463e with scrape type 2
2026-03-27 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f41c111c-f8e7-5809-862a-f2f05136463e with scrape type 2
2026-03-27 11:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f41c111c-f8e7-5809-862a-f2f05136463e, identifier: MS10113
2026-03-27 11:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f41c111c-f8e7-5809-862a-f2f05136463e with identifier: MS10113
2026-03-27 11:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f41c111c-f8e7-5809-862a-f2f05136463e with identifier: MS10113
2026-03-27 11:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f41c111c-f8e7-5809-862a-f2f05136463e with identifier: MS10113 to the API
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-27T16:25:50Z',
 'fuel_type': 'diesel',
 'id': 'f41c111c-f8e7-5809-862a-f2f05136463e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS10113',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 113314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-10',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS10113%27 HTTP/1.1" 200 None
2026-03-27 11:34:11 [auto1.be] INFO: Saving data for MS10113: {'auction_closing_time': 1774628750.0, 'created_time': 1774524689.458644, 'last_price_update_time': 1774611251.605395}
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MS10113') HTTP/1.1" 204 0
2026-03-27 11:34:11 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-27 11:34:11 [auto1.be] INFO: Found listing with ID: BP83172
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP83172%27 HTTP/1.1" 200 None
2026-03-27 11:34:11 [auto1.be] INFO: Scrape type for BP83172: 2
2026-03-27 11:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a386bbc-a6c2-5dc4-85a0-2bae1743e6a1 with identifier: BP83172
2026-03-27 11:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a386bbc-a6c2-5dc4-85a0-2bae1743e6a1 with scrape type 2
2026-03-27 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a386bbc-a6c2-5dc4-85a0-2bae1743e6a1 with scrape type 2
2026-03-27 11:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3a386bbc-a6c2-5dc4-85a0-2bae1743e6a1, identifier: BP83172
2026-03-27 11:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3a386bbc-a6c2-5dc4-85a0-2bae1743e6a1 with identifier: BP83172
2026-03-27 11:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3a386bbc-a6c2-5dc4-85a0-2bae1743e6a1 with identifier: BP83172
2026-03-27 11:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3a386bbc-a6c2-5dc4-85a0-2bae1743e6a1 with identifier: BP83172 to the API
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:41:38Z',
 'fuel_type': 'diesel',
 'id': '3a386bbc-a6c2-5dc4-85a0-2bae1743e6a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP83172',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 147452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-22',
 'seller_name': None,
 'title': 'Citroen C5 1.6 HDi Tendance',
 'transmission': 'automatic',
 'trim': 'Tendance',
 'year': 2012}
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP83172%27 HTTP/1.1" 200 None
2026-03-27 11:34:11 [auto1.be] INFO: Saving data for BP83172: {'auction_closing_time': 1774629698.0, 'created_time': 1774524695.969365, 'last_price_update_time': 1774611251.972009}
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BP83172') HTTP/1.1" 204 0
2026-03-27 11:34:11 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-27 11:34:11 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-27 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-27 11:34:12 [auto1.be] INFO: Scrape type for WE68493: 2
2026-03-27 11:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with identifier: WE68493
2026-03-27 11:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with scrape type 2
2026-03-27 11:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with scrape type 2
2026-03-27 11:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3, identifier: WE68493
2026-03-27 11:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with identifier: WE68493
2026-03-27 11:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with identifier: WE68493
2026-03-27 11:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with identifier: WE68493 to the API
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:34:51Z',
 'fuel_type': 'petrol',
 'id': '2d931e28-ca20-5db0-8f32-ebe4c7b3ade3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE68493',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 139607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-07',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2014}
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-27 11:34:12 [auto1.be] INFO: Saving data for WE68493: {'auction_closing_time': 1774629291.0, 'created_time': 1774524698.240862, 'last_price_update_time': 1774611252.358093}
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WE68493') HTTP/1.1" 204 0
2026-03-27 11:34:12 [auto1.be] INFO: Found listing with ID: VC37293
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC37293%27 HTTP/1.1" 200 None
2026-03-27 11:34:12 [auto1.be] INFO: Scrape type for VC37293: 2
2026-03-27 11:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3381d5b-650c-5629-a34f-8ec551b33685 with identifier: VC37293
2026-03-27 11:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3381d5b-650c-5629-a34f-8ec551b33685 with scrape type 2
2026-03-27 11:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3381d5b-650c-5629-a34f-8ec551b33685 with scrape type 2
2026-03-27 11:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3381d5b-650c-5629-a34f-8ec551b33685, identifier: VC37293
2026-03-27 11:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3381d5b-650c-5629-a34f-8ec551b33685 with identifier: VC37293
2026-03-27 11:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3381d5b-650c-5629-a34f-8ec551b33685 with identifier: VC37293
2026-03-27 11:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3381d5b-650c-5629-a34f-8ec551b33685 with identifier: VC37293 to the API
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:39:08Z',
 'fuel_type': 'diesel',
 'id': 'd3381d5b-650c-5629-a34f-8ec551b33685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC37293',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 187062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-25',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2011}
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC37293%27 HTTP/1.1" 200 None
2026-03-27 11:34:12 [auto1.be] INFO: Saving data for VC37293: {'auction_closing_time': 1774629548.0, 'created_time': 1773233667.11411, 'last_price_update_time': 1774611252.826863}
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VC37293') HTTP/1.1" 204 0
2026-03-27 11:34:12 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-27 11:34:12 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-27 11:34:12 [auto1.be] INFO: Found listing with ID: VY13057
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY13057%27 HTTP/1.1" 200 None
2026-03-27 11:34:12 [auto1.be] INFO: Scrape type for VY13057: 0
2026-03-27 11:34:12 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-27 11:34:12 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-27 11:34:12 [auto1.be] INFO: Scrape type for DM43787: 2
2026-03-27 11:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31db4384-c889-5b5f-b915-6a34124f01b1 with identifier: DM43787
2026-03-27 11:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31db4384-c889-5b5f-b915-6a34124f01b1 with scrape type 2
2026-03-27 11:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31db4384-c889-5b5f-b915-6a34124f01b1 with scrape type 2
2026-03-27 11:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31db4384-c889-5b5f-b915-6a34124f01b1, identifier: DM43787
2026-03-27 11:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31db4384-c889-5b5f-b915-6a34124f01b1 with identifier: DM43787
2026-03-27 11:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31db4384-c889-5b5f-b915-6a34124f01b1 with identifier: DM43787
2026-03-27 11:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31db4384-c889-5b5f-b915-6a34124f01b1 with identifier: DM43787 to the API
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-27T16:53:55Z',
 'fuel_type': 'hybrid',
 'id': '31db4384-c889-5b5f-b915-6a34124f01b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM43787',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 88783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300e T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-27 11:34:13 [auto1.be] INFO: Saving data for DM43787: {'auction_closing_time': 1774630435.0, 'created_time': 1774524697.362488, 'last_price_update_time': 1774611253.245116}
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DM43787') HTTP/1.1" 204 0
2026-03-27 11:34:13 [auto1.be] INFO: Found listing with ID: XX33825
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX33825%27 HTTP/1.1" 200 None
2026-03-27 11:34:13 [auto1.be] INFO: Scrape type for XX33825: 2
2026-03-27 11:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d202b409-7c36-525b-b11d-e7b917dcba9b with identifier: XX33825
2026-03-27 11:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d202b409-7c36-525b-b11d-e7b917dcba9b with scrape type 2
2026-03-27 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d202b409-7c36-525b-b11d-e7b917dcba9b with scrape type 2
2026-03-27 11:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d202b409-7c36-525b-b11d-e7b917dcba9b, identifier: XX33825
2026-03-27 11:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d202b409-7c36-525b-b11d-e7b917dcba9b with identifier: XX33825
2026-03-27 11:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d202b409-7c36-525b-b11d-e7b917dcba9b with identifier: XX33825
2026-03-27 11:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d202b409-7c36-525b-b11d-e7b917dcba9b with identifier: XX33825 to the API
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:41:47Z',
 'fuel_type': 'diesel',
 'id': 'd202b409-7c36-525b-b11d-e7b917dcba9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX33825',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 123490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-18',
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2021}
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX33825%27 HTTP/1.1" 200 None
2026-03-27 11:34:13 [auto1.be] INFO: Saving data for XX33825: {'auction_closing_time': 1774629707.0, 'created_time': 1774524726.147709, 'last_price_update_time': 1774611253.620268}
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XX33825') HTTP/1.1" 204 0
2026-03-27 11:34:13 [auto1.be] INFO: Channel: 24h | Page: 45 | totalHits: 1869 | hits on page: 40
2026-03-27 11:34:13 [auto1.be] INFO: Found listing with ID: XB71990
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB71990%27 HTTP/1.1" 200 None
2026-03-27 11:34:13 [auto1.be] INFO: Scrape type for XB71990: 0
2026-03-27 11:34:13 [auto1.be] INFO: Found listing with ID: ZK72697
2026-03-27 11:34:13 [auto1.be] INFO: Found listing with ID: GF77372
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF77372%27 HTTP/1.1" 200 None
2026-03-27 11:34:13 [auto1.be] INFO: Scrape type for GF77372: 2
2026-03-27 11:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7e8ebc2-a65b-58d0-91b1-520dcbba524b with identifier: GF77372
2026-03-27 11:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7e8ebc2-a65b-58d0-91b1-520dcbba524b with scrape type 2
2026-03-27 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7e8ebc2-a65b-58d0-91b1-520dcbba524b with scrape type 2
2026-03-27 11:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d7e8ebc2-a65b-58d0-91b1-520dcbba524b, identifier: GF77372
2026-03-27 11:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d7e8ebc2-a65b-58d0-91b1-520dcbba524b with identifier: GF77372
2026-03-27 11:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d7e8ebc2-a65b-58d0-91b1-520dcbba524b with identifier: GF77372
2026-03-27 11:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d7e8ebc2-a65b-58d0-91b1-520dcbba524b with identifier: GF77372 to the API
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:28:56Z',
 'fuel_type': 'diesel',
 'id': 'd7e8ebc2-a65b-58d0-91b1-520dcbba524b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF77372',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 245668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-02',
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF77372%27 HTTP/1.1" 200 None
2026-03-27 11:34:14 [auto1.be] INFO: Saving data for GF77372: {'auction_closing_time': 1774628936.0, 'created_time': 1774524733.390848, 'last_price_update_time': 1774611254.02304}
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF77372') HTTP/1.1" 204 0
2026-03-27 11:34:14 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-27 11:34:14 [auto1.be] INFO: Scrape type for TX85632: 2
2026-03-27 11:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7e17219-8ea2-5bf3-a798-8eb189081cf9 with identifier: TX85632
2026-03-27 11:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7e17219-8ea2-5bf3-a798-8eb189081cf9 with scrape type 2
2026-03-27 11:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7e17219-8ea2-5bf3-a798-8eb189081cf9 with scrape type 2
2026-03-27 11:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f7e17219-8ea2-5bf3-a798-8eb189081cf9, identifier: TX85632
2026-03-27 11:34:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:34:14 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-27 11:34:14 [auto1.be] INFO: Scrape type for DY95002: 2
2026-03-27 11:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78f06f82-f920-59e5-875b-b7273d1fb069 with identifier: DY95002
2026-03-27 11:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78f06f82-f920-59e5-875b-b7273d1fb069 with scrape type 2
2026-03-27 11:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78f06f82-f920-59e5-875b-b7273d1fb069 with scrape type 2
2026-03-27 11:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78f06f82-f920-59e5-875b-b7273d1fb069, identifier: DY95002
2026-03-27 11:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f7e17219-8ea2-5bf3-a798-8eb189081cf9 with identifier: TX85632
2026-03-27 11:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f7e17219-8ea2-5bf3-a798-8eb189081cf9 with identifier: TX85632
2026-03-27 11:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f7e17219-8ea2-5bf3-a798-8eb189081cf9 with identifier: TX85632 to the API
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:22:46Z',
 'fuel_type': 'petrol',
 'id': 'f7e17219-8ea2-5bf3-a798-8eb189081cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX85632',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 66001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-30',
 'seller_name': None,
 'title': 'Peugeot 108 1.0 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-27 11:34:14 [auto1.be] INFO: Saving data for TX85632: {'auction_closing_time': 1774628566.0, 'created_time': 1774524732.510847, 'last_price_update_time': 1774611254.512709}
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX85632') HTTP/1.1" 204 0
2026-03-27 11:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78f06f82-f920-59e5-875b-b7273d1fb069 with identifier: DY95002
2026-03-27 11:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78f06f82-f920-59e5-875b-b7273d1fb069 with identifier: DY95002
2026-03-27 11:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78f06f82-f920-59e5-875b-b7273d1fb069 with identifier: DY95002 to the API
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:14:04Z',
 'fuel_type': 'diesel',
 'id': '78f06f82-f920-59e5-875b-b7273d1fb069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY95002',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 220067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-16',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.3 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-27 11:34:14 [auto1.be] INFO: Saving data for DY95002: {'auction_closing_time': 1774628044.0, 'created_time': 1774524731.538607, 'last_price_update_time': 1774611254.869924}
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY95002') HTTP/1.1" 204 0
2026-03-27 11:34:14 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-27 11:34:14 [auto1.be] INFO: Scrape type for GG74067: 2
2026-03-27 11:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d81d6d19-1ec9-53be-813e-e43f33ce72f3 with identifier: GG74067
2026-03-27 11:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d81d6d19-1ec9-53be-813e-e43f33ce72f3 with scrape type 2
2026-03-27 11:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d81d6d19-1ec9-53be-813e-e43f33ce72f3 with scrape type 2
2026-03-27 11:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d81d6d19-1ec9-53be-813e-e43f33ce72f3, identifier: GG74067
2026-03-27 11:34:15 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-27 11:34:15 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-27 11:34:15 [auto1.be] INFO: Scrape type for TX85632: 0
2026-03-27 11:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d81d6d19-1ec9-53be-813e-e43f33ce72f3 with identifier: GG74067
2026-03-27 11:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d81d6d19-1ec9-53be-813e-e43f33ce72f3 with identifier: GG74067
2026-03-27 11:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d81d6d19-1ec9-53be-813e-e43f33ce72f3 with identifier: GG74067 to the API
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:25:11Z',
 'fuel_type': 'petrol',
 'id': 'd81d6d19-1ec9-53be-813e-e43f33ce72f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG74067',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 258823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-08-21',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.6 Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2002}
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-27 11:34:15 [auto1.be] INFO: Saving data for GG74067: {'auction_closing_time': 1774628711.0, 'created_time': 1774524730.657489, 'last_price_update_time': 1774611255.280467}
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GG74067') HTTP/1.1" 204 0
2026-03-27 11:34:15 [auto1.be] INFO: Found listing with ID: NS58610
2026-03-27 11:34:15 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-27 11:34:15 [auto1.be] INFO: Found listing with ID: DK34546
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK34546%27 HTTP/1.1" 200 None
2026-03-27 11:34:15 [auto1.be] INFO: Scrape type for DK34546: 2
2026-03-27 11:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64a39ebe-fdc0-50f0-a949-d0b67afa800a with identifier: DK34546
2026-03-27 11:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64a39ebe-fdc0-50f0-a949-d0b67afa800a with scrape type 2
2026-03-27 11:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64a39ebe-fdc0-50f0-a949-d0b67afa800a with scrape type 2
2026-03-27 11:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64a39ebe-fdc0-50f0-a949-d0b67afa800a, identifier: DK34546
2026-03-27 11:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64a39ebe-fdc0-50f0-a949-d0b67afa800a with identifier: DK34546
2026-03-27 11:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64a39ebe-fdc0-50f0-a949-d0b67afa800a with identifier: DK34546
2026-03-27 11:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64a39ebe-fdc0-50f0-a949-d0b67afa800a with identifier: DK34546 to the API
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:49:19Z',
 'fuel_type': 'petrol',
 'id': '64a39ebe-fdc0-50f0-a949-d0b67afa800a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK34546',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 22346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-17',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2021}
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK34546%27 HTTP/1.1" 200 None
2026-03-27 11:34:15 [auto1.be] INFO: Saving data for DK34546: {'auction_closing_time': 1774630159.0, 'created_time': 1774524721.559016, 'last_price_update_time': 1774611255.675833}
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DK34546') HTTP/1.1" 204 0
2026-03-27 11:34:15 [auto1.be] INFO: Found listing with ID: WV42280
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV42280%27 HTTP/1.1" 200 None
2026-03-27 11:34:15 [auto1.be] INFO: Scrape type for WV42280: 0
2026-03-27 11:34:15 [auto1.be] INFO: Found listing with ID: WC57902
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC57902%27 HTTP/1.1" 200 None
2026-03-27 11:34:15 [auto1.be] INFO: Scrape type for WC57902: 0
2026-03-27 11:34:15 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE43146%27 HTTP/1.1" 200 None
2026-03-27 11:34:15 [auto1.be] INFO: Scrape type for UE43146: 2
2026-03-27 11:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e99c6370-3c28-520f-af64-ef1a4351f6c2 with identifier: UE43146
2026-03-27 11:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e99c6370-3c28-520f-af64-ef1a4351f6c2 with scrape type 2
2026-03-27 11:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e99c6370-3c28-520f-af64-ef1a4351f6c2 with scrape type 2
2026-03-27 11:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e99c6370-3c28-520f-af64-ef1a4351f6c2, identifier: UE43146
2026-03-27 11:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e99c6370-3c28-520f-af64-ef1a4351f6c2 with identifier: UE43146
2026-03-27 11:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e99c6370-3c28-520f-af64-ef1a4351f6c2 with identifier: UE43146
2026-03-27 11:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e99c6370-3c28-520f-af64-ef1a4351f6c2 with identifier: UE43146 to the API
2026-03-27 11:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 345,
 'expiration_date': '2026-03-27T16:27:40Z',
 'fuel_type': 'hybrid',
 'id': 'e99c6370-3c28-520f-af64-ef1a4351f6c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE43146',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'GS-Serie',
 'odometer': 157587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-03',
 'seller_name': None,
 'title': 'Lexus GS-Serie GS 450h',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE43146%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Saving data for UE43146: {'auction_closing_time': 1774628860.0, 'created_time': 1774125150.46042, 'last_price_update_time': 1774611256.242418}
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UE43146') HTTP/1.1" 204 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: JE75068
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE75068%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for JE75068: 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15920%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for MB15920: 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for JM27578: 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: SX47012
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX47012%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for SX47012: 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: BN70432
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: TE49722
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for HM84114: 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: SJ92859
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: UR29395
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: AV51049
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV51049%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for AV51049: 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: GB18331
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for LW74134: 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: KG32291
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG32291%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for KG32291: 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: WV50060
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: XZ93211
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: NP41015
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: AP97194
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for UW48636: 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: EW28397
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW28397%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for EW28397: 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: RL73626
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL73626%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for RL73626: 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: XE54467
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: VS66255
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS66255%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for VS66255: 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: TF91319
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: SA78346
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA78346%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for SA78346: 0
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: KL13323
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: AN69845
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-27 11:34:16 [auto1.be] INFO: Found listing with ID: HB59251
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59251%27 HTTP/1.1" 200 None
2026-03-27 11:34:16 [auto1.be] INFO: Scrape type for HB59251: 0
2026-03-27 11:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:34:17 [auto1.be] INFO: Channel: 24h | Page: 46 | totalHits: 1869 | hits on page: 40
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: WG39475
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG39475%27 HTTP/1.1" 200 None
2026-03-27 11:34:17 [auto1.be] INFO: Scrape type for WG39475: 0
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-27 11:34:17 [auto1.be] INFO: Scrape type for UM90025: 0
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG64643%27 HTTP/1.1" 200 None
2026-03-27 11:34:17 [auto1.be] INFO: Scrape type for PG64643: 0
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: WG25142
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG25142%27 HTTP/1.1" 200 None
2026-03-27 11:34:17 [auto1.be] INFO: Scrape type for WG25142: 0
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: ER55137
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: GT24920
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: JT25813
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT25813%27 HTTP/1.1" 200 None
2026-03-27 11:34:17 [auto1.be] INFO: Scrape type for JT25813: 0
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-27 11:34:17 [auto1.be] INFO: Scrape type for XC64567: 0
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: GW87029
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: EY13692
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: NA79982
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA79982%27 HTTP/1.1" 200 None
2026-03-27 11:34:17 [auto1.be] INFO: Scrape type for NA79982: 0
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: KZ21578
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-27 11:34:17 [auto1.be] INFO: Scrape type for TV92859: 0
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-27 11:34:17 [auto1.be] INFO: Scrape type for RF80171: 0
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: BJ84732
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ84732%27 HTTP/1.1" 200 None
2026-03-27 11:34:17 [auto1.be] INFO: Scrape type for BJ84732: 0
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-27 11:34:17 [auto1.be] INFO: Scrape type for SZ65946: 0
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: WM16539
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: TY97185
2026-03-27 11:34:17 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT59149%27 HTTP/1.1" 200 None
2026-03-27 11:34:17 [auto1.be] INFO: Scrape type for HT59149: 2
2026-03-27 11:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fda8e606-4305-5a23-8ddb-c02a5820fac8 with identifier: HT59149
2026-03-27 11:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda8e606-4305-5a23-8ddb-c02a5820fac8 with scrape type 2
2026-03-27 11:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fda8e606-4305-5a23-8ddb-c02a5820fac8 with scrape type 2
2026-03-27 11:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fda8e606-4305-5a23-8ddb-c02a5820fac8, identifier: HT59149
2026-03-27 11:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fda8e606-4305-5a23-8ddb-c02a5820fac8 with identifier: HT59149
2026-03-27 11:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fda8e606-4305-5a23-8ddb-c02a5820fac8 with identifier: HT59149
2026-03-27 11:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fda8e606-4305-5a23-8ddb-c02a5820fac8 with identifier: HT59149 to the API
2026-03-27 11:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:29:55Z',
 'fuel_type': 'diesel',
 'id': 'fda8e606-4305-5a23-8ddb-c02a5820fac8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT59149',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 175520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT59149%27 HTTP/1.1" 200 None
2026-03-27 11:34:18 [auto1.be] INFO: Saving data for HT59149: {'auction_closing_time': 1774628995.0, 'created_time': 1774125131.130835, 'last_price_update_time': 1774611258.650076}
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT59149') HTTP/1.1" 204 0
2026-03-27 11:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU19738%27 HTTP/1.1" 200 None
2026-03-27 11:34:18 [auto1.be] INFO: Scrape type for SU19738: 0
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-27 11:34:18 [auto1.be] INFO: Scrape type for ZG73435: 0
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: MS53866
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS53866%27 HTTP/1.1" 200 None
2026-03-27 11:34:18 [auto1.be] INFO: Scrape type for MS53866: 0
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-27 11:34:18 [auto1.be] INFO: Scrape type for LM00165: 0
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-27 11:34:18 [auto1.be] INFO: Scrape type for DU38710: 0
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: FT07874
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT07874%27 HTTP/1.1" 200 None
2026-03-27 11:34:18 [auto1.be] INFO: Scrape type for FT07874: 0
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: HZ61170
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ61170%27 HTTP/1.1" 200 None
2026-03-27 11:34:18 [auto1.be] INFO: Scrape type for HZ61170: 0
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: VL30706
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-27 11:34:18 [auto1.be] INFO: Scrape type for LK29098: 0
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: HF21497
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: EJ63633
2026-03-27 11:34:18 [auto1.be] INFO: Found listing with ID: GF59002
2026-03-27 11:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:34:19 [auto1.be] INFO: Channel: 24h | Page: 47 | totalHits: 1869 | hits on page: 29
2026-03-27 11:34:19 [auto1.be] INFO: Found listing with ID: AX26323
2026-03-27 11:34:19 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-27 11:34:19 [auto1.be] INFO: Found listing with ID: GX63977
2026-03-27 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX63977%27 HTTP/1.1" 200 None
2026-03-27 11:34:19 [auto1.be] INFO: Scrape type for GX63977: 0
2026-03-27 11:34:19 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-27 11:34:19 [auto1.be] INFO: Found listing with ID: VR03629
2026-03-27 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR03629%27 HTTP/1.1" 200 None
2026-03-27 11:34:19 [auto1.be] INFO: Scrape type for VR03629: 0
2026-03-27 11:34:19 [auto1.be] INFO: Found listing with ID: PP06553
2026-03-27 11:34:19 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-27 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-27 11:34:19 [auto1.be] INFO: Scrape type for WP21428: 0
2026-03-27 11:34:19 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-27 11:34:19 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-27 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-27 11:34:19 [auto1.be] INFO: Scrape type for JF41683: 0
2026-03-27 11:34:19 [auto1.be] INFO: Found listing with ID: GE86423
2026-03-27 11:34:19 [auto1.be] INFO: Found listing with ID: BC09650
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC09650%27 HTTP/1.1" 200 None
2026-03-27 11:34:20 [auto1.be] INFO: Scrape type for BC09650: 2
2026-03-27 11:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c41f7556-ebc8-57a6-a10f-1c322f204c16 with identifier: BC09650
2026-03-27 11:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c41f7556-ebc8-57a6-a10f-1c322f204c16 with scrape type 2
2026-03-27 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c41f7556-ebc8-57a6-a10f-1c322f204c16 with scrape type 2
2026-03-27 11:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c41f7556-ebc8-57a6-a10f-1c322f204c16, identifier: BC09650
2026-03-27 11:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c41f7556-ebc8-57a6-a10f-1c322f204c16 with identifier: BC09650
2026-03-27 11:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c41f7556-ebc8-57a6-a10f-1c322f204c16 with identifier: BC09650
2026-03-27 11:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c41f7556-ebc8-57a6-a10f-1c322f204c16 with identifier: BC09650 to the API
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:46:06Z',
 'fuel_type': 'diesel',
 'id': 'c41f7556-ebc8-57a6-a10f-1c322f204c16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC09650',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 207314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-27',
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2015}
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC09650%27 HTTP/1.1" 200 None
2026-03-27 11:34:20 [auto1.be] INFO: Saving data for BC09650: {'auction_closing_time': 1774629966.0, 'created_time': 1773131704.102415, 'last_price_update_time': 1774611260.440925}
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC09650') HTTP/1.1" 204 0
2026-03-27 11:34:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-27 11:34:20 [auto1.be] INFO: Scrape type for VA87646: 0
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: WZ44217
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-27 11:34:20 [auto1.be] INFO: Scrape type for VM06685: 0
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: YW35122
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: RR60731
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: LX24377
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-27 11:34:20 [auto1.be] INFO: Scrape type for GN45273: 0
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-27 11:34:20 [auto1.be] INFO: Scrape type for MK11042: 0
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: KW54495
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-27 11:34:20 [auto1.be] INFO: Scrape type for MB19665: 0
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: BH51844
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-27 11:34:20 [auto1.be] INFO: Scrape type for ZK51287: 0
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: UW31030
2026-03-27 11:34:20 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-27 11:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:34:21 [auto1.be] INFO: Channel: 24h | Page: 48 | totalHits: 1869 | hits on page: 0
2026-03-27 11:34:21 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 11:34:21 [auto1.be] INFO: auto1.be Batch config: batch 1/2
2026-03-27 11:34:21 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 6, <ScrapeType.BATCH_SKIPPED: 5>: 12}
2026-03-27 11:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20last_price_update_time%20lt%201774179261 HTTP/1.1" 200 None
2026-03-27 11:34:21 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (232 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_25_2026-03-27T11_30_00.jl
2026-03-27 11:34:21 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 775346,
 'downloader/request_count': 434,
 'downloader/request_method_count/GET': 384,
 'downloader/request_method_count/POST': 50,
 'downloader/response_bytes': 105260904,
 'downloader/response_count': 434,
 'downloader/response_status_count/200': 434,
 'dupefilter/filtered': 16,
 'elapsed_time_seconds': 254.736105,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 11, 34, 21, 463454, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 232,
 'log_count/DEBUG': 6462,
 'log_count/INFO': 7065,
 'memusage/max': 196161536,
 'memusage/startup': 149905408,
 'photo_download_count': 268,
 'request_depth_max': 51,
 'response_received_count': 166,
 'scheduler/dequeued': 434,
 'scheduler/dequeued/memory': 434,
 'scheduler/enqueued': 434,
 'scheduler/enqueued/memory': 434,
 'scrape_type/batch_skipped': 908,
 'scrape_type/new': 57,
 'scrape_type/price_update': 175,
 'scrape_type/skipped': 753,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 166,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.410405057067253,
 'scrapy-zyte-api/mean_response_seconds': 3.4568013248050646,
 'scrapy-zyte-api/processed': 166,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 166,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 165,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 166,
 'scrapy-zyte-api/request_args/httpRequestBody': 50,
 'scrapy-zyte-api/request_args/httpRequestMethod': 50,
 'scrapy-zyte-api/request_args/httpResponseBody': 166,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 166,
 'scrapy-zyte-api/request_args/sessionContext': 166,
 'scrapy-zyte-api/request_args/url': 166,
 'scrapy-zyte-api/status_codes/200': 166,
 'scrapy-zyte-api/success': 166,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1909,
 'source/total_available': 1869,
 'start_time': datetime.datetime(2026, 3, 27, 11, 30, 6, 727349, tzinfo=datetime.timezone.utc)}
2026-03-27 11:34:21 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-27 11:34:21 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f66f2c9e350>
2026-03-27 11:34:21 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f66f2df0290>