2026-03-28 11:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 11:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 11:30:06 [auto1.be] INFO: Batch mode enabled: batch 1/2
2026-03-28 11:30:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-28 11:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 11:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 11:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 11:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 11:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 4565f299d30688c7
2026-03-28 11:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 11:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_25_2026-03-28T11_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 11:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 11:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 11:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 11:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 11:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 11:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 11:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 11:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-28 11:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 11:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 11:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 11:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 11:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 11:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 11:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 11:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 11:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 11:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 11:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 11:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-28 11:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 11:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 11:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 11:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 11:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 11:30:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 11:30:22 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1816 | hits on page: 40
2026-03-28 11:30:22 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-28 11:30:22 [auto1.be] INFO: Found listing with ID: RK64902
2026-03-28 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK64902%27 HTTP/1.1" 200 None
2026-03-28 11:30:22 [auto1.be] INFO: Scrape type for RK64902: 1
2026-03-28 11:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:22 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-28 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK14732%27 HTTP/1.1" 200 None
2026-03-28 11:30:22 [auto1.be] INFO: Scrape type for EK14732: 1
2026-03-28 11:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:22 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-28 11:30:22 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-28 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR02836%27 HTTP/1.1" 200 None
2026-03-28 11:30:22 [auto1.be] INFO: Scrape type for UR02836: 1
2026-03-28 11:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:22 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-28 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK01311%27 HTTP/1.1" 200 None
2026-03-28 11:30:22 [auto1.be] INFO: Scrape type for XK01311: 2
2026-03-28 11:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4d70a71-daf1-5172-8ed9-705eaa3cd3ee with identifier: XK01311
2026-03-28 11:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4d70a71-daf1-5172-8ed9-705eaa3cd3ee with scrape type 2
2026-03-28 11:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4d70a71-daf1-5172-8ed9-705eaa3cd3ee with scrape type 2
2026-03-28 11:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4d70a71-daf1-5172-8ed9-705eaa3cd3ee, identifier: XK01311
2026-03-28 11:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4d70a71-daf1-5172-8ed9-705eaa3cd3ee with identifier: XK01311
2026-03-28 11:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:30:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 11:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:30:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 11:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4d70a71-daf1-5172-8ed9-705eaa3cd3ee with identifier: XK01311
2026-03-28 11:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4d70a71-daf1-5172-8ed9-705eaa3cd3ee with identifier: XK01311 to the API
2026-03-28 11:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:12Z',
 'fuel_type': 'diesel',
 'id': 'f4d70a71-daf1-5172-8ed9-705eaa3cd3ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK01311',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 174287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-02',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Classic Blue',
 'transmission': 'manual',
 'trim': 'Classic Blue',
 'year': 2016}
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK01311%27 HTTP/1.1" 200 None
2026-03-28 11:30:24 [auto1.be] INFO: Saving data for XK01311: {'auction_closing_time': 1774883232.0, 'created_time': 1774002094.431217, 'last_price_update_time': 1774697424.110265}
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK01311') HTTP/1.1" 204 0
2026-03-28 11:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED41371%27 HTTP/1.1" 200 None
2026-03-28 11:30:24 [auto1.be] INFO: Scrape type for ED41371: 2
2026-03-28 11:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e2555b-3ba3-5f4c-9f51-72b6b25cc575 with identifier: ED41371
2026-03-28 11:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e2555b-3ba3-5f4c-9f51-72b6b25cc575 with scrape type 2
2026-03-28 11:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56e2555b-3ba3-5f4c-9f51-72b6b25cc575 with scrape type 2
2026-03-28 11:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56e2555b-3ba3-5f4c-9f51-72b6b25cc575, identifier: ED41371
2026-03-28 11:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56e2555b-3ba3-5f4c-9f51-72b6b25cc575 with identifier: ED41371
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 11:30:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 11:30:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56e2555b-3ba3-5f4c-9f51-72b6b25cc575 with identifier: ED41371
2026-03-28 11:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56e2555b-3ba3-5f4c-9f51-72b6b25cc575 with identifier: ED41371 to the API
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:27:40Z',
 'fuel_type': 'petrol',
 'id': '56e2555b-3ba3-5f4c-9f51-72b6b25cc575',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED41371',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 104745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-23',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X-Play',
 'transmission': 'manual',
 'trim': 'X-Play',
 'year': 2017}
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED41371%27 HTTP/1.1" 200 None
2026-03-28 11:30:24 [auto1.be] INFO: Saving data for ED41371: {'auction_closing_time': 1774884460.0, 'created_time': 1773348518.221899, 'last_price_update_time': 1774697424.848845}
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ED41371') HTTP/1.1" 204 0
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX51166%27 HTTP/1.1" 200 None
2026-03-28 11:30:24 [auto1.be] INFO: Scrape type for VX51166: 1
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: CE40234
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD29807%27 HTTP/1.1" 200 None
2026-03-28 11:30:24 [auto1.be] INFO: Scrape type for BD29807: 1
2026-03-28 11:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26009%27 HTTP/1.1" 200 None
2026-03-28 11:30:24 [auto1.be] INFO: Scrape type for ZJ26009: 1
2026-03-28 11:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR36013%27 HTTP/1.1" 200 None
2026-03-28 11:30:24 [auto1.be] INFO: Scrape type for LR36013: 1
2026-03-28 11:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50404%27 HTTP/1.1" 200 None
2026-03-28 11:30:24 [auto1.be] INFO: Scrape type for TX50404: 1
2026-03-28 11:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: VK18525
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR69689%27 HTTP/1.1" 200 None
2026-03-28 11:30:24 [auto1.be] INFO: Scrape type for HR69689: 1
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-28 11:30:24 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-28 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC15884%27 HTTP/1.1" 200 None
2026-03-28 11:30:25 [auto1.be] INFO: Scrape type for FC15884: 1
2026-03-28 11:30:25 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-28 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX73156%27 HTTP/1.1" 200 None
2026-03-28 11:30:25 [auto1.be] INFO: Scrape type for KX73156: 1
2026-03-28 11:30:25 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-28 11:30:25 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-28 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ00073%27 HTTP/1.1" 200 None
2026-03-28 11:30:25 [auto1.be] INFO: Scrape type for SZ00073: 2
2026-03-28 11:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c080186-d2ca-5851-8ae0-8f66b1f9b21c with identifier: SZ00073
2026-03-28 11:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c080186-d2ca-5851-8ae0-8f66b1f9b21c with scrape type 2
2026-03-28 11:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c080186-d2ca-5851-8ae0-8f66b1f9b21c with scrape type 2
2026-03-28 11:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c080186-d2ca-5851-8ae0-8f66b1f9b21c, identifier: SZ00073
2026-03-28 11:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c080186-d2ca-5851-8ae0-8f66b1f9b21c with identifier: SZ00073
2026-03-28 11:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c080186-d2ca-5851-8ae0-8f66b1f9b21c with identifier: SZ00073
2026-03-28 11:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c080186-d2ca-5851-8ae0-8f66b1f9b21c with identifier: SZ00073 to the API
2026-03-28 11:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:55Z',
 'fuel_type': 'petrol',
 'id': '1c080186-d2ca-5851-8ae0-8f66b1f9b21c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ00073',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 101307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-14',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2016}
2026-03-28 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ00073%27 HTTP/1.1" 200 None
2026-03-28 11:30:26 [auto1.be] INFO: Saving data for SZ00073: {'auction_closing_time': 1774883215.0, 'created_time': 1774038857.097012, 'last_price_update_time': 1774697426.567575}
2026-03-28 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ00073') HTTP/1.1" 204 0
2026-03-28 11:30:26 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-28 11:30:26 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-28 11:30:26 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-28 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA73486%27 HTTP/1.1" 200 None
2026-03-28 11:30:26 [auto1.be] INFO: Scrape type for CA73486: 1
2026-03-28 11:30:26 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-28 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU74968%27 HTTP/1.1" 200 None
2026-03-28 11:30:26 [auto1.be] INFO: Scrape type for NU74968: 1
2026-03-28 11:30:26 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-28 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX14373%27 HTTP/1.1" 200 None
2026-03-28 11:30:26 [auto1.be] INFO: Scrape type for WX14373: 1
2026-03-28 11:30:26 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-28 11:30:26 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-28 11:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK14732/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK64902/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ26009/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX51166/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR02836/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:27 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1816 | hits on page: 40
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: RK64902
2026-03-28 11:30:27 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/RK64902/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-28 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK01311%27 HTTP/1.1" 200 None
2026-03-28 11:30:27 [auto1.be] INFO: Scrape type for XK01311: 0
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-28 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED41371%27 HTTP/1.1" 200 None
2026-03-28 11:30:27 [auto1.be] INFO: Scrape type for ED41371: 0
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: CE40234
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: VK18525
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-28 11:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR36013/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-28 11:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-28 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ00073%27 HTTP/1.1" 200 None
2026-03-28 11:30:27 [auto1.be] INFO: Scrape type for SZ00073: 0
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-28 11:30:27 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-28 11:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD29807/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX50404/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR69689/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU74968/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WX14373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA73486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX73156/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC15884/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK64902> (referer: https://www.auto1.com/v1/car-details-view/RK64902/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cddb6da-beff-504e-a93b-07e6bca4dfcc with identifier: RK64902
2026-03-28 11:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cddb6da-beff-504e-a93b-07e6bca4dfcc with scrape type 1
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3cddb6da-beff-504e-a93b-07e6bca4dfcc
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Ff8%252Fe9f86cf9a47f7550a9694ebabf7031cc%252Fpa%252FRK64902_7bbd88e180de574100e688d44b01924e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_7bbd88e180de574100e688d44b01924e.jpg not downloaded yet
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Ff8%252Fe9f86cf9a47f7550a9694ebabf7031cc%252Fpa%252FRK64902_a656dd9b815316faa14348e14704e04f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_a656dd9b815316faa14348e14704e04f.jpg not downloaded yet
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Ff8%252Fe9f86cf9a47f7550a9694ebabf7031cc%252Fpa%252FRK64902_cccab7257c0755501127dffa772cc0e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_cccab7257c0755501127dffa772cc0e0.jpg not downloaded yet
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Ff8%252Fe9f86cf9a47f7550a9694ebabf7031cc%252Fpa%252FRK64902_c97d28e6a6da81e3486c2cddc43e429f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_c97d28e6a6da81e3486c2cddc43e429f.jpg not downloaded yet
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Ff8%252Fe9f86cf9a47f7550a9694ebabf7031cc%252Fpa%252FRK64902_29a67dc86d464257c38af21f477edd32.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_29a67dc86d464257c38af21f477edd32.jpg not downloaded yet
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Ff8%252Fe9f86cf9a47f7550a9694ebabf7031cc%252Fpa%252FRK64902_7269846f6132627c7850b1bd7dd0b6d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_7269846f6132627c7850b1bd7dd0b6d1.jpg not downloaded yet
2026-03-28 11:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_a656dd9b815316faa14348e14704e04f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_7bbd88e180de574100e688d44b01924e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_7269846f6132627c7850b1bd7dd0b6d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_29a67dc86d464257c38af21f477edd32.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_c97d28e6a6da81e3486c2cddc43e429f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ26009> (referer: https://www.auto1.com/v1/car-details-view/ZJ26009/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_cccab7257c0755501127dffa772cc0e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa43cbdd0>
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2106
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cddb6da-beff-504e-a93b-07e6bca4dfcc/3cddb6da-beff-504e-a93b-07e6bca4dfcc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Ff8%252Fe9f86cf9a47f7550a9694ebabf7031cc%252Fpa%252FRK64902_a656dd9b815316faa14348e14704e04f.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_a656dd9b815316faa14348e14704e04f.jpg saved to cache
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3cddb6da-beff-504e-a93b-07e6bca4dfcc
2026-03-28 11:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK14732> (referer: https://www.auto1.com/v1/car-details-view/EK14732/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX51166> (referer: https://www.auto1.com/v1/car-details-view/VX51166/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR36013> (referer: https://www.auto1.com/v1/car-details-view/LR36013/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa43ea3d0>
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cddb6da-beff-504e-a93b-07e6bca4dfcc/3cddb6da-beff-504e-a93b-07e6bca4dfcc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Ff8%252Fe9f86cf9a47f7550a9694ebabf7031cc%252Fpa%252FRK64902_7bbd88e180de574100e688d44b01924e.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_7bbd88e180de574100e688d44b01924e.jpg saved to cache
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3cddb6da-beff-504e-a93b-07e6bca4dfcc
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4337b50>
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cddb6da-beff-504e-a93b-07e6bca4dfcc/3cddb6da-beff-504e-a93b-07e6bca4dfcc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Ff8%252Fe9f86cf9a47f7550a9694ebabf7031cc%252Fpa%252FRK64902_7269846f6132627c7850b1bd7dd0b6d1.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_7269846f6132627c7850b1bd7dd0b6d1.jpg saved to cache
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3cddb6da-beff-504e-a93b-07e6bca4dfcc
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4338750>
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cddb6da-beff-504e-a93b-07e6bca4dfcc/3cddb6da-beff-504e-a93b-07e6bca4dfcc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Ff8%252Fe9f86cf9a47f7550a9694ebabf7031cc%252Fpa%252FRK64902_29a67dc86d464257c38af21f477edd32.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_29a67dc86d464257c38af21f477edd32.jpg saved to cache
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3cddb6da-beff-504e-a93b-07e6bca4dfcc
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4335810>
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cddb6da-beff-504e-a93b-07e6bca4dfcc/3cddb6da-beff-504e-a93b-07e6bca4dfcc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Ff8%252Fe9f86cf9a47f7550a9694ebabf7031cc%252Fpa%252FRK64902_c97d28e6a6da81e3486c2cddc43e429f.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_c97d28e6a6da81e3486c2cddc43e429f.jpg saved to cache
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3cddb6da-beff-504e-a93b-07e6bca4dfcc
2026-03-28 11:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef856ef4-db6c-5637-9d07-afdae111ee37 with identifier: ZJ26009
2026-03-28 11:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef856ef4-db6c-5637-9d07-afdae111ee37 with scrape type 1
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef856ef4-db6c-5637-9d07-afdae111ee37
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_49a88004f6a858eefef46db4a7c3b249.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_49a88004f6a858eefef46db4a7c3b249.jpg not downloaded yet
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa6bc5990>
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cddb6da-beff-504e-a93b-07e6bca4dfcc/3cddb6da-beff-504e-a93b-07e6bca4dfcc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Ff8%252Fe9f86cf9a47f7550a9694ebabf7031cc%252Fpa%252FRK64902_cccab7257c0755501127dffa772cc0e0.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_cccab7257c0755501127dffa772cc0e0.jpg saved to cache
2026-03-28 11:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3cddb6da-beff-504e-a93b-07e6bca4dfcc
2026-03-28 11:30:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3cddb6da-beff-504e-a93b-07e6bca4dfcc, skipping ID generation
2026-03-28 11:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cddb6da-beff-504e-a93b-07e6bca4dfcc with scrape type 1
2026-03-28 11:30:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3cddb6da-beff-504e-a93b-07e6bca4dfcc sending to next pipeline
2026-03-28 11:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3cddb6da-beff-504e-a93b-07e6bca4dfcc, identifier: RK64902
2026-03-28 11:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3cddb6da-beff-504e-a93b-07e6bca4dfcc with identifier: RK64902
2026-03-28 11:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:30:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 11:30:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3cddb6da-beff-504e-a93b-07e6bca4dfcc with identifier: RK64902
2026-03-28 11:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3cddb6da-beff-504e-a93b-07e6bca4dfcc with identifier: RK64902 to the API
2026-03-28 11:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_cccab7257c0755501127dffa772cc0e0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 87,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:20:46Z',
 'fuel_type': 'diesel',
 'id': '3cddb6da-beff-504e-a93b-07e6bca4dfcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK64902',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 197736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cddb6da-beff-504e-a93b-07e6bca4dfcc/3cddb6da-beff-504e-a93b-07e6bca4dfcc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_7bbd88e180de574100e688d44b01924e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cddb6da-beff-504e-a93b-07e6bca4dfcc/3cddb6da-beff-504e-a93b-07e6bca4dfcc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_a656dd9b815316faa14348e14704e04f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cddb6da-beff-504e-a93b-07e6bca4dfcc/3cddb6da-beff-504e-a93b-07e6bca4dfcc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_cccab7257c0755501127dffa772cc0e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cddb6da-beff-504e-a93b-07e6bca4dfcc/3cddb6da-beff-504e-a93b-07e6bca4dfcc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_c97d28e6a6da81e3486c2cddc43e429f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cddb6da-beff-504e-a93b-07e6bca4dfcc/3cddb6da-beff-504e-a93b-07e6bca4dfcc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_29a67dc86d464257c38af21f477edd32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cddb6da-beff-504e-a93b-07e6bca4dfcc/3cddb6da-beff-504e-a93b-07e6bca4dfcc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/f8/e9f86cf9a47f7550a9694ebabf7031cc/pa/RK64902_7269846f6132627c7850b1bd7dd0b6d1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.4 HDi Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2012}
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK64902%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [auto1.be] INFO: Saving data for RK64902: {'created_time': 1774697432.147175, 'last_price_update_time': 1774697432.147187, 'auction_closing_time': 1774884046.0}
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK64902') HTTP/1.1" 204 0
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_7e7c0baa6f06e929837a290d74ae6143.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_7e7c0baa6f06e929837a290d74ae6143.jpg not downloaded yet
2026-03-28 11:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX50404> (referer: https://www.auto1.com/v1/car-details-view/TX50404/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_56f4159fbda39d18afaea38464070edf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_56f4159fbda39d18afaea38464070edf.jpg not downloaded yet
2026-03-28 11:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR02836> (referer: https://www.auto1.com/v1/car-details-view/UR02836/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD29807> (referer: https://www.auto1.com/v1/car-details-view/BD29807/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:32 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1816 | hits on page: 40
2026-03-28 11:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceb0e50d-5171-51f2-aac4-e266009560e3 with identifier: EK14732
2026-03-28 11:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceb0e50d-5171-51f2-aac4-e266009560e3 with scrape type 1
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ceb0e50d-5171-51f2-aac4-e266009560e3
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F81%252F3881b810309754c5096e46d1a8d22dda%252Fpa%252FEK14732_155e33cf6262387f7ff83fcd4c248d55.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_155e33cf6262387f7ff83fcd4c248d55.jpg not downloaded yet
2026-03-28 11:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f1acef5-aad0-5707-b995-cc1bd85f4d16 with identifier: VX51166
2026-03-28 11:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f1acef5-aad0-5707-b995-cc1bd85f4d16 with scrape type 1
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3f1acef5-aad0-5707-b995-cc1bd85f4d16
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F07%252F57075965bc2f5d3f86849fd03808fad4%252Fpa%252FVX51166_af6244ca0f658e7f9a2c34b99992709e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_af6244ca0f658e7f9a2c34b99992709e.jpg not downloaded yet
2026-03-28 11:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7851fcd-848f-552e-bb27-09862abc5ccc with identifier: LR36013
2026-03-28 11:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7851fcd-848f-552e-bb27-09862abc5ccc with scrape type 1
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7851fcd-848f-552e-bb27-09862abc5ccc
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_70cc9f133efa16b96883d5257d9a191c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_70cc9f133efa16b96883d5257d9a191c.jpg not downloaded yet
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_dc10cb7c2efed4385b8f4ab37e9e6718.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_dc10cb7c2efed4385b8f4ab37e9e6718.jpg not downloaded yet
2026-03-28 11:30:32 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-28 11:30:32 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW60531%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [auto1.be] INFO: Scrape type for SW60531: 1
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F81%252F3881b810309754c5096e46d1a8d22dda%252Fpa%252FEK14732_98d6b909ae11e70b5dda8c3e9a4ab032.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_98d6b909ae11e70b5dda8c3e9a4ab032.jpg not downloaded yet
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F07%252F57075965bc2f5d3f86849fd03808fad4%252Fpa%252FVX51166_7fd22f71c837e7d45e1c812d27ec1f3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_7fd22f71c837e7d45e1c812d27ec1f3a.jpg not downloaded yet
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_52d2a00f2da223c2b783ed0051d938a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_52d2a00f2da223c2b783ed0051d938a8.jpg not downloaded yet
2026-03-28 11:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_c70417aab972c63050cea2aa9bfdb614.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_c70417aab972c63050cea2aa9bfdb614.jpg not downloaded yet
2026-03-28 11:30:32 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-28 11:30:32 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH65741%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [auto1.be] INFO: Scrape type for KH65741: 1
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F81%252F3881b810309754c5096e46d1a8d22dda%252Fpa%252FEK14732_0db5a595a9cdbf1415182d69e3fc65f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_0db5a595a9cdbf1415182d69e3fc65f8.jpg not downloaded yet
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F07%252F57075965bc2f5d3f86849fd03808fad4%252Fpa%252FVX51166_befaa09b9a2c9fa36229b49467adc77c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_befaa09b9a2c9fa36229b49467adc77c.jpg not downloaded yet
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_88bf20465719533ba7e3dc6394dc88ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_88bf20465719533ba7e3dc6394dc88ca.jpg not downloaded yet
2026-03-28 11:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115 with identifier: TX50404
2026-03-28 11:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115 with scrape type 1
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_5134dab408a1f982825d99c634531cc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_5134dab408a1f982825d99c634531cc9.jpg not downloaded yet
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_e118a421fc84aae1c87b7c43bd4387b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_e118a421fc84aae1c87b7c43bd4387b4.jpg not downloaded yet
2026-03-28 11:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b8f9d8e-56d3-501a-a3bf-fd247e39458e with identifier: UR02836
2026-03-28 11:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8f9d8e-56d3-501a-a3bf-fd247e39458e with scrape type 1
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9b8f9d8e-56d3-501a-a3bf-fd247e39458e
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F08%252Fe008542458bd80f5449a17a31e3862fc%252Fpa%252FUR02836_2a60496edd99a8478a8471f546f73dd9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_2a60496edd99a8478a8471f546f73dd9.jpg not downloaded yet
2026-03-28 11:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2d6e7b1-b46c-568d-ae50-09a5e955b1f3 with identifier: BD29807
2026-03-28 11:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2d6e7b1-b46c-568d-ae50-09a5e955b1f3 with scrape type 1
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2d6e7b1-b46c-568d-ae50-09a5e955b1f3
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc0%252Fafc071d7c5c1826e89abd4f7f7943759%252Fpa%252FBD29807_4099d9c4f785fbdc9cdd2a9abdb8f138.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_4099d9c4f785fbdc9cdd2a9abdb8f138.jpg already downloaded
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc0%252Fafc071d7c5c1826e89abd4f7f7943759%252Fpa%252FBD29807_83e3929b9de01fcf5f7f7e7ebe2022f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_83e3929b9de01fcf5f7f7e7ebe2022f5.jpg already downloaded
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc0%252Fafc071d7c5c1826e89abd4f7f7943759%252Fpa%252FBD29807_3508841043d58345e1b9c71ec650d6a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_3508841043d58345e1b9c71ec650d6a9.jpg already downloaded
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc0%252Fafc071d7c5c1826e89abd4f7f7943759%252Fpa%252FBD29807_d955a1de810db3ffd42c7cb14d9e44f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_d955a1de810db3ffd42c7cb14d9e44f8.jpg already downloaded
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc0%252Fafc071d7c5c1826e89abd4f7f7943759%252Fpa%252FBD29807_e518e1ea455adef83e5ca8927caa100d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_e518e1ea455adef83e5ca8927caa100d.jpg already downloaded
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc0%252Fafc071d7c5c1826e89abd4f7f7943759%252Fpa%252FBD29807_29cd81913e7c1ece7d560d840939103a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_29cd81913e7c1ece7d560d840939103a.jpg already downloaded
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc0%252Fafc071d7c5c1826e89abd4f7f7943759%252Fpa%252FBD29807_ee796922a1811e89686a4c46c4445797.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_ee796922a1811e89686a4c46c4445797.jpg already downloaded
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc0%252Fafc071d7c5c1826e89abd4f7f7943759%252Fpa%252FBD29807_055668c6b45712f29060b4c6be43bbe1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_055668c6b45712f29060b4c6be43bbe1.jpg already downloaded
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc0%252Fafc071d7c5c1826e89abd4f7f7943759%252Fpa%252FBD29807_5dab69b5e097de4cb7105eea6312fff0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_5dab69b5e097de4cb7105eea6312fff0.jpg already downloaded
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc0%252Fafc071d7c5c1826e89abd4f7f7943759%252Fpa%252FBD29807_acbb9aaf09f7990cb4de20179d1bd329.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_acbb9aaf09f7990cb4de20179d1bd329.jpg already downloaded
2026-03-28 11:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f2d6e7b1-b46c-568d-ae50-09a5e955b1f3, identifier: BD29807
2026-03-28 11:30:32 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ51820%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [auto1.be] INFO: Scrape type for JJ51820: 1
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F81%252F3881b810309754c5096e46d1a8d22dda%252Fpa%252FEK14732_e11dcb1df490d19780ef3a779a7832d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_e11dcb1df490d19780ef3a779a7832d9.jpg not downloaded yet
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F07%252F57075965bc2f5d3f86849fd03808fad4%252Fpa%252FVX51166_f725be4a5c16c22c3008a2e520d0efd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_f725be4a5c16c22c3008a2e520d0efd3.jpg not downloaded yet
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_edc4ffb30c1781aecbcff0535d97cee0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_edc4ffb30c1781aecbcff0535d97cee0.jpg not downloaded yet
2026-03-28 11:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_90ef98a27cd3b9d291d95d2b5426a765.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_90ef98a27cd3b9d291d95d2b5426a765.jpg not downloaded yet
2026-03-28 11:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f2d6e7b1-b46c-568d-ae50-09a5e955b1f3 with identifier: BD29807
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f2d6e7b1-b46c-568d-ae50-09a5e955b1f3 with identifier: BD29807
2026-03-28 11:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f2d6e7b1-b46c-568d-ae50-09a5e955b1f3 with identifier: BD29807 to the API
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BD29807>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:44:05Z',
 'fuel_type': 'petrol',
 'id': 'f2d6e7b1-b46c-568d-ae50-09a5e955b1f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD29807',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 153863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_4099d9c4f785fbdc9cdd2a9abdb8f138.jpg',
                'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_83e3929b9de01fcf5f7f7e7ebe2022f5.jpg',
                'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_3508841043d58345e1b9c71ec650d6a9.jpg',
                'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_d955a1de810db3ffd42c7cb14d9e44f8.jpg',
                'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_e518e1ea455adef83e5ca8927caa100d.jpg',
                'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_29cd81913e7c1ece7d560d840939103a.jpg',
                'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_ee796922a1811e89686a4c46c4445797.jpg',
                'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_055668c6b45712f29060b4c6be43bbe1.jpg',
                'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_5dab69b5e097de4cb7105eea6312fff0.jpg',
                'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_acbb9aaf09f7990cb4de20179d1bd329.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2d6e7b1-b46c-568d-ae50-09a5e955b1f3/f2d6e7b1-b46c-568d-ae50-09a5e955b1f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2467133,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_4099d9c4f785fbdc9cdd2a9abdb8f138.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2d6e7b1-b46c-568d-ae50-09a5e955b1f3/f2d6e7b1-b46c-568d-ae50-09a5e955b1f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_83e3929b9de01fcf5f7f7e7ebe2022f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2d6e7b1-b46c-568d-ae50-09a5e955b1f3/f2d6e7b1-b46c-568d-ae50-09a5e955b1f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_3508841043d58345e1b9c71ec650d6a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2d6e7b1-b46c-568d-ae50-09a5e955b1f3/f2d6e7b1-b46c-568d-ae50-09a5e955b1f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_d955a1de810db3ffd42c7cb14d9e44f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2d6e7b1-b46c-568d-ae50-09a5e955b1f3/f2d6e7b1-b46c-568d-ae50-09a5e955b1f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_e518e1ea455adef83e5ca8927caa100d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2d6e7b1-b46c-568d-ae50-09a5e955b1f3/f2d6e7b1-b46c-568d-ae50-09a5e955b1f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_29cd81913e7c1ece7d560d840939103a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2d6e7b1-b46c-568d-ae50-09a5e955b1f3/f2d6e7b1-b46c-568d-ae50-09a5e955b1f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_ee796922a1811e89686a4c46c4445797.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2d6e7b1-b46c-568d-ae50-09a5e955b1f3/f2d6e7b1-b46c-568d-ae50-09a5e955b1f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_055668c6b45712f29060b4c6be43bbe1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2d6e7b1-b46c-568d-ae50-09a5e955b1f3/f2d6e7b1-b46c-568d-ae50-09a5e955b1f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_5dab69b5e097de4cb7105eea6312fff0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2d6e7b1-b46c-568d-ae50-09a5e955b1f3/f2d6e7b1-b46c-568d-ae50-09a5e955b1f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c0/afc071d7c5c1826e89abd4f7f7943759/pa/BD29807_acbb9aaf09f7990cb4de20179d1bd329.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.3 TCe BOSE-Edition',
 'transmission': 'manual',
 'trim': 'BOSE-Edition',
 'year': 2019}
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD29807%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [auto1.be] INFO: Saving data for BD29807: {'created_time': 1774697433.450077, 'last_price_update_time': 1774697433.450087, 'auction_closing_time': 1774885445.0}
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BD29807') HTTP/1.1" 204 0
2026-03-28 11:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_7e7c0baa6f06e929837a290d74ae6143.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_dbd735fb73039cfedef119144807775b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_dbd735fb73039cfedef119144807775b.jpg not downloaded yet
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F08%252Fe008542458bd80f5449a17a31e3862fc%252Fpa%252FUR02836_0e733a9065d97b24afdf195df125cb17.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_0e733a9065d97b24afdf195df125cb17.jpg not downloaded yet
2026-03-28 11:30:33 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV58665%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [auto1.be] INFO: Scrape type for CV58665: 1
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F81%252F3881b810309754c5096e46d1a8d22dda%252Fpa%252FEK14732_9d08a0e1434a84dee5e2f037a09555e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_9d08a0e1434a84dee5e2f037a09555e0.jpg not downloaded yet
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F07%252F57075965bc2f5d3f86849fd03808fad4%252Fpa%252FVX51166_3f194f74fb27746dcde1f3710574042c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_3f194f74fb27746dcde1f3710574042c.jpg not downloaded yet
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_e86d9df0cf131359f80bf287e2537003.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_e86d9df0cf131359f80bf287e2537003.jpg not downloaded yet
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_28a6f87c7de0de1ef84a9cfc94377124.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_28a6f87c7de0de1ef84a9cfc94377124.jpg not downloaded yet
2026-03-28 11:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WX14373> (referer: https://www.auto1.com/v1/car-details-view/WX14373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU74968> (referer: https://www.auto1.com/v1/car-details-view/NU74968/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_bca42c63cfab6ca4be4f69be1c9125f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_bca42c63cfab6ca4be4f69be1c9125f7.jpg not downloaded yet
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F08%252Fe008542458bd80f5449a17a31e3862fc%252Fpa%252FUR02836_837a1f286d2e7a7ffbea99cf70be6541.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_837a1f286d2e7a7ffbea99cf70be6541.jpg not downloaded yet
2026-03-28 11:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR69689> (referer: https://www.auto1.com/v1/car-details-view/HR69689/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:33 [auto1.be] INFO: Found listing with ID: JB88665
2026-03-28 11:30:33 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE94103%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [auto1.be] INFO: Scrape type for NE94103: 1
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F81%252F3881b810309754c5096e46d1a8d22dda%252Fpa%252FEK14732_446c52758971aa5b499db68510b405d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_446c52758971aa5b499db68510b405d3.jpg not downloaded yet
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F07%252F57075965bc2f5d3f86849fd03808fad4%252Fpa%252FVX51166_0122620d2db4cab22636bb770295506c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_0122620d2db4cab22636bb770295506c.jpg not downloaded yet
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_2bc7d872e2eba48e825ba1f95e48765c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_2bc7d872e2eba48e825ba1f95e48765c.jpg not downloaded yet
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_59c34f2b5b9e59547f0ba82e03ef4083.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_59c34f2b5b9e59547f0ba82e03ef4083.jpg not downloaded yet
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_d1bd990bd7f6d583aabdbcde443db120.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_d1bd990bd7f6d583aabdbcde443db120.jpg not downloaded yet
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F08%252Fe008542458bd80f5449a17a31e3862fc%252Fpa%252FUR02836_f0badfa7c2b95698f849e3b8fb7c6a74.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_f0badfa7c2b95698f849e3b8fb7c6a74.jpg not downloaded yet
2026-03-28 11:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_7fd22f71c837e7d45e1c812d27ec1f3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:33 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC51689%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [auto1.be] INFO: Scrape type for RC51689: 1
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_f41f7e23032e0475aba67f93593521d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_f41f7e23032e0475aba67f93593521d8.jpg not downloaded yet
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_4faccf71e553a2ba0a644377770e17c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_4faccf71e553a2ba0a644377770e17c6.jpg not downloaded yet
2026-03-28 11:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa433b590>
2026-03-28 11:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_7e7c0baa6f06e929837a290d74ae6143.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_7e7c0baa6f06e929837a290d74ae6143.jpg saved to cache
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef856ef4-db6c-5637-9d07-afdae111ee37
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_077e7e933f9633f95a15f3e1ea8130c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_077e7e933f9633f95a15f3e1ea8130c6.jpg not downloaded yet
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F08%252Fe008542458bd80f5449a17a31e3862fc%252Fpa%252FUR02836_9607f450d33d3c57327f4b9d10718c4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_9607f450d33d3c57327f4b9d10718c4c.jpg not downloaded yet
2026-03-28 11:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA73486> (referer: https://www.auto1.com/v1/car-details-view/CA73486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX73156> (referer: https://www.auto1.com/v1/car-details-view/KX73156/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:34 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-28 11:30:34 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-28 11:30:34 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-28 11:30:34 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB41449%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [auto1.be] INFO: Scrape type for KB41449: 1
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_7e07c67c2b7423c02f319900e30fca66.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_7e07c67c2b7423c02f319900e30fca66.jpg not downloaded yet
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_43aa5f5f360be0962583a88553054dc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_43aa5f5f360be0962583a88553054dc5.jpg not downloaded yet
2026-03-28 11:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee3c260f-b0af-54bb-993a-3c6407d64d3d with identifier: WX14373
2026-03-28 11:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee3c260f-b0af-54bb-993a-3c6407d64d3d with scrape type 1
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee3c260f-b0af-54bb-993a-3c6407d64d3d
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa1%252F68a11c84b7f55c2a5230840763ea632f%252Fpa%252FWX14373_8af6bd577ea9a0d4a8cee1a465a0d400.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_8af6bd577ea9a0d4a8cee1a465a0d400.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa1%252F68a11c84b7f55c2a5230840763ea632f%252Fpa%252FWX14373_76ce29fd5af816e63ccc1d0fd5960b71.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_76ce29fd5af816e63ccc1d0fd5960b71.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa1%252F68a11c84b7f55c2a5230840763ea632f%252Fpa%252FWX14373_4ff375bc18cfce4a994623af05c0c5a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_4ff375bc18cfce4a994623af05c0c5a1.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa1%252F68a11c84b7f55c2a5230840763ea632f%252Fpa%252FWX14373_0a6e423192af35d38da3ce8934c541b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_0a6e423192af35d38da3ce8934c541b9.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa1%252F68a11c84b7f55c2a5230840763ea632f%252Fpa%252FWX14373_c3885b199212e67ff63e71224bc2dc32.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_c3885b199212e67ff63e71224bc2dc32.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa1%252F68a11c84b7f55c2a5230840763ea632f%252Fpa%252FWX14373_aaf450925aa836b92777f791ef3d1dc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_aaf450925aa836b92777f791ef3d1dc4.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa1%252F68a11c84b7f55c2a5230840763ea632f%252Fpa%252FWX14373_f615af9d894ea52cb95e7fbd9c8cc74a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_f615af9d894ea52cb95e7fbd9c8cc74a.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa1%252F68a11c84b7f55c2a5230840763ea632f%252Fpa%252FWX14373_c97ccc0cf266f9005dd71de0b009ee6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_c97ccc0cf266f9005dd71de0b009ee6e.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa1%252F68a11c84b7f55c2a5230840763ea632f%252Fpa%252FWX14373_239a76733f6d2d7cfb92072ca78969af.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_239a76733f6d2d7cfb92072ca78969af.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa1%252F68a11c84b7f55c2a5230840763ea632f%252Fpa%252FWX14373_360ddb6b7096302bf26dc3e49c57d8ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_360ddb6b7096302bf26dc3e49c57d8ff.jpg already downloaded
2026-03-28 11:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee3c260f-b0af-54bb-993a-3c6407d64d3d, identifier: WX14373
2026-03-28 11:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41735558-5028-59dd-8be8-4f433bed79b2 with identifier: NU74968
2026-03-28 11:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41735558-5028-59dd-8be8-4f433bed79b2 with scrape type 1
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41735558-5028-59dd-8be8-4f433bed79b2
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F05%252F530564d771a8a44b26e705b7c3d30d40%252Fpa%252FNU74968_05072d2305064be957314f4950bcc0b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_05072d2305064be957314f4950bcc0b0.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F05%252F530564d771a8a44b26e705b7c3d30d40%252Fpa%252FNU74968_e7154030e86b7e16f5a22489ca3415f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_e7154030e86b7e16f5a22489ca3415f1.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F05%252F530564d771a8a44b26e705b7c3d30d40%252Fpa%252FNU74968_2869bc3099a243a6bc057a2160e1f9d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_2869bc3099a243a6bc057a2160e1f9d2.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F05%252F530564d771a8a44b26e705b7c3d30d40%252Fpa%252FNU74968_e9d46cf9978f21dbfc47921f59d5a1fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_e9d46cf9978f21dbfc47921f59d5a1fc.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F05%252F530564d771a8a44b26e705b7c3d30d40%252Fpa%252FNU74968_507014b7075196b7edbb6e8ede2deb1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_507014b7075196b7edbb6e8ede2deb1a.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F05%252F530564d771a8a44b26e705b7c3d30d40%252Fpa%252FNU74968_2d1cee4de3b771516f2ee05a3e202a23.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_2d1cee4de3b771516f2ee05a3e202a23.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F05%252F530564d771a8a44b26e705b7c3d30d40%252Fpa%252FNU74968_a6a84691ba6b8da25790407b48449ec3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_a6a84691ba6b8da25790407b48449ec3.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F05%252F530564d771a8a44b26e705b7c3d30d40%252Fpa%252FNU74968_daa73a3d281b0419271e90c8f779537d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_daa73a3d281b0419271e90c8f779537d.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F05%252F530564d771a8a44b26e705b7c3d30d40%252Fpa%252FNU74968_78bbd58cd15d7519d1db676ef1ddcbd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_78bbd58cd15d7519d1db676ef1ddcbd2.jpg already downloaded
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F05%252F530564d771a8a44b26e705b7c3d30d40%252Fpa%252FNU74968_9a579e81f75e80bad020aa85fe1e086a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_9a579e81f75e80bad020aa85fe1e086a.jpg already downloaded
2026-03-28 11:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41735558-5028-59dd-8be8-4f433bed79b2, identifier: NU74968
2026-03-28 11:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d6e0103-20c0-5073-8551-c220d276f1a5 with identifier: HR69689
2026-03-28 11:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d6e0103-20c0-5073-8551-c220d276f1a5 with scrape type 1
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7d6e0103-20c0-5073-8551-c220d276f1a5
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fe2%252F10e27f5538436904f3ff1f90cdb1d832%252Fpa%252FHR69689_b42595d08f5cec511c959fd2a31a14fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_b42595d08f5cec511c959fd2a31a14fc.jpg not downloaded yet
2026-03-28 11:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_af6244ca0f658e7f9a2c34b99992709e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_70cc9f133efa16b96883d5257d9a191c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F08%252Fe008542458bd80f5449a17a31e3862fc%252Fpa%252FUR02836_1a5ae42979b7ff394ab5347174e439e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_1a5ae42979b7ff394ab5347174e439e3.jpg not downloaded yet
2026-03-28 11:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee3c260f-b0af-54bb-993a-3c6407d64d3d with identifier: WX14373
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 11:30:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:30:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 11:30:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee3c260f-b0af-54bb-993a-3c6407d64d3d with identifier: WX14373
2026-03-28 11:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee3c260f-b0af-54bb-993a-3c6407d64d3d with identifier: WX14373 to the API
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WX14373>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:03:30Z',
 'fuel_type': 'hybrid',
 'id': 'ee3c260f-b0af-54bb-993a-3c6407d64d3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX14373',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 125159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_8af6bd577ea9a0d4a8cee1a465a0d400.jpg',
                'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_76ce29fd5af816e63ccc1d0fd5960b71.jpg',
                'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_4ff375bc18cfce4a994623af05c0c5a1.jpg',
                'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_0a6e423192af35d38da3ce8934c541b9.jpg',
                'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_c3885b199212e67ff63e71224bc2dc32.jpg',
                'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_aaf450925aa836b92777f791ef3d1dc4.jpg',
                'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_f615af9d894ea52cb95e7fbd9c8cc74a.jpg',
                'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_c97ccc0cf266f9005dd71de0b009ee6e.jpg',
                'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_239a76733f6d2d7cfb92072ca78969af.jpg',
                'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_360ddb6b7096302bf26dc3e49c57d8ff.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3c260f-b0af-54bb-993a-3c6407d64d3d/ee3c260f-b0af-54bb-993a-3c6407d64d3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2640871,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_8af6bd577ea9a0d4a8cee1a465a0d400.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3c260f-b0af-54bb-993a-3c6407d64d3d/ee3c260f-b0af-54bb-993a-3c6407d64d3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612090,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_76ce29fd5af816e63ccc1d0fd5960b71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3c260f-b0af-54bb-993a-3c6407d64d3d/ee3c260f-b0af-54bb-993a-3c6407d64d3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577071,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_4ff375bc18cfce4a994623af05c0c5a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3c260f-b0af-54bb-993a-3c6407d64d3d/ee3c260f-b0af-54bb-993a-3c6407d64d3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2859588,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_0a6e423192af35d38da3ce8934c541b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3c260f-b0af-54bb-993a-3c6407d64d3d/ee3c260f-b0af-54bb-993a-3c6407d64d3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_c3885b199212e67ff63e71224bc2dc32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3c260f-b0af-54bb-993a-3c6407d64d3d/ee3c260f-b0af-54bb-993a-3c6407d64d3d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2666698,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_aaf450925aa836b92777f791ef3d1dc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3c260f-b0af-54bb-993a-3c6407d64d3d/ee3c260f-b0af-54bb-993a-3c6407d64d3d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2672777,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_f615af9d894ea52cb95e7fbd9c8cc74a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3c260f-b0af-54bb-993a-3c6407d64d3d/ee3c260f-b0af-54bb-993a-3c6407d64d3d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2630403,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_c97ccc0cf266f9005dd71de0b009ee6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3c260f-b0af-54bb-993a-3c6407d64d3d/ee3c260f-b0af-54bb-993a-3c6407d64d3d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2549974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_239a76733f6d2d7cfb92072ca78969af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3c260f-b0af-54bb-993a-3c6407d64d3d/ee3c260f-b0af-54bb-993a-3c6407d64d3d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3383923,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/a1/68a11c84b7f55c2a5230840763ea632f/pa/WX14373_360ddb6b7096302bf26dc3e49c57d8ff.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2019}
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX14373%27 HTTP/1.1" 200 None
2026-03-28 11:30:35 [auto1.be] INFO: Saving data for WX14373: {'created_time': 1774697435.38496, 'last_price_update_time': 1774697435.384973, 'auction_closing_time': 1774883010.0}
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WX14373') HTTP/1.1" 204 0
2026-03-28 11:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41735558-5028-59dd-8be8-4f433bed79b2 with identifier: NU74968
2026-03-28 11:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41735558-5028-59dd-8be8-4f433bed79b2 with identifier: NU74968
2026-03-28 11:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41735558-5028-59dd-8be8-4f433bed79b2 with identifier: NU74968 to the API
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NU74968>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:57:28Z',
 'fuel_type': 'petrol',
 'id': '41735558-5028-59dd-8be8-4f433bed79b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU74968',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 61029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_05072d2305064be957314f4950bcc0b0.jpg',
                'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_e7154030e86b7e16f5a22489ca3415f1.jpg',
                'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_2869bc3099a243a6bc057a2160e1f9d2.jpg',
                'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_e9d46cf9978f21dbfc47921f59d5a1fc.jpg',
                'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_507014b7075196b7edbb6e8ede2deb1a.jpg',
                'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_2d1cee4de3b771516f2ee05a3e202a23.jpg',
                'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_a6a84691ba6b8da25790407b48449ec3.jpg',
                'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_daa73a3d281b0419271e90c8f779537d.jpg',
                'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_78bbd58cd15d7519d1db676ef1ddcbd2.jpg',
                'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_9a579e81f75e80bad020aa85fe1e086a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41735558-5028-59dd-8be8-4f433bed79b2/41735558-5028-59dd-8be8-4f433bed79b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52061,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_05072d2305064be957314f4950bcc0b0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41735558-5028-59dd-8be8-4f433bed79b2/41735558-5028-59dd-8be8-4f433bed79b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55319,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_e7154030e86b7e16f5a22489ca3415f1.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41735558-5028-59dd-8be8-4f433bed79b2/41735558-5028-59dd-8be8-4f433bed79b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52636,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_2869bc3099a243a6bc057a2160e1f9d2.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41735558-5028-59dd-8be8-4f433bed79b2/41735558-5028-59dd-8be8-4f433bed79b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47073,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_e9d46cf9978f21dbfc47921f59d5a1fc.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41735558-5028-59dd-8be8-4f433bed79b2/41735558-5028-59dd-8be8-4f433bed79b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47408,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_507014b7075196b7edbb6e8ede2deb1a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41735558-5028-59dd-8be8-4f433bed79b2/41735558-5028-59dd-8be8-4f433bed79b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_2d1cee4de3b771516f2ee05a3e202a23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41735558-5028-59dd-8be8-4f433bed79b2/41735558-5028-59dd-8be8-4f433bed79b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_a6a84691ba6b8da25790407b48449ec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41735558-5028-59dd-8be8-4f433bed79b2/41735558-5028-59dd-8be8-4f433bed79b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_daa73a3d281b0419271e90c8f779537d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41735558-5028-59dd-8be8-4f433bed79b2/41735558-5028-59dd-8be8-4f433bed79b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_78bbd58cd15d7519d1db676ef1ddcbd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41735558-5028-59dd-8be8-4f433bed79b2/41735558-5028-59dd-8be8-4f433bed79b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/05/530564d771a8a44b26e705b7c3d30d40/pa/NU74968_9a579e81f75e80bad020aa85fe1e086a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Turbo Mirror',
 'transmission': 'manual',
 'trim': 'Mirror',
 'year': 2019}
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU74968%27 HTTP/1.1" 200 None
2026-03-28 11:30:35 [auto1.be] INFO: Saving data for NU74968: {'created_time': 1774697435.785873, 'last_price_update_time': 1774697435.785884, 'auction_closing_time': 1774886248.0}
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NU74968') HTTP/1.1" 204 0
2026-03-28 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_155e33cf6262387f7ff83fcd4c248d55.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_2a60496edd99a8478a8471f546f73dd9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:35 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-28 11:30:35 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-28 11:30:35 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-28 11:30:35 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-28 11:30:35 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU94491%27 HTTP/1.1" 200 None
2026-03-28 11:30:35 [auto1.be] INFO: Scrape type for JU94491: 1
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_716082c9f19f98f09cd012ca28a256d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_716082c9f19f98f09cd012ca28a256d1.jpg not downloaded yet
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_848dbe3e7efad41f284ab0c6ba2f9fb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_848dbe3e7efad41f284ab0c6ba2f9fb0.jpg not downloaded yet
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fe2%252F10e27f5538436904f3ff1f90cdb1d832%252Fpa%252FHR69689_5fceb675a1ed9cc207737df3e4d2a0cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_5fceb675a1ed9cc207737df3e4d2a0cd.jpg not downloaded yet
2026-03-28 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC15884> (referer: https://www.auto1.com/v1/car-details-view/FC15884/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa428ad10>
2026-03-28 11:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1acef5-aad0-5707-b995-cc1bd85f4d16/3f1acef5-aad0-5707-b995-cc1bd85f4d16_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F07%252F57075965bc2f5d3f86849fd03808fad4%252Fpa%252FVX51166_7fd22f71c837e7d45e1c812d27ec1f3a.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_7fd22f71c837e7d45e1c812d27ec1f3a.jpg saved to cache
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f1acef5-aad0-5707-b995-cc1bd85f4d16
2026-03-28 11:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9970f351-8e7b-5b05-806e-ef9f53ff2274 with identifier: CA73486
2026-03-28 11:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9970f351-8e7b-5b05-806e-ef9f53ff2274 with scrape type 1
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9970f351-8e7b-5b05-806e-ef9f53ff2274
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_d875dd0187ed86c616f62642b9e752b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_d875dd0187ed86c616f62642b9e752b4.jpg not downloaded yet
2026-03-28 11:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d4b38b4-c5ac-582c-8269-3dfe1108d249 with identifier: KX73156
2026-03-28 11:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249 with scrape type 1
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_d88a48376440da4bd0bd7e8379c82623.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_d88a48376440da4bd0bd7e8379c82623.jpg not downloaded yet
2026-03-28 11:30:36 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-28 11:30:36 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU93740%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [auto1.be] INFO: Scrape type for PU93740: 1
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_6fa77fdd6a977bd95185631b73a47e19.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_6fa77fdd6a977bd95185631b73a47e19.jpg not downloaded yet
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_9832c62e4996af7f4a7e59d1336a3b62.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_9832c62e4996af7f4a7e59d1336a3b62.jpg not downloaded yet
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fe2%252F10e27f5538436904f3ff1f90cdb1d832%252Fpa%252FHR69689_84df0d3bd1ff164a1add797e576ac03b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_84df0d3bd1ff164a1add797e576ac03b.jpg not downloaded yet
2026-03-28 11:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_dbd735fb73039cfedef119144807775b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_251d2915de4cbba57cf7630a3d3fcd24.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_251d2915de4cbba57cf7630a3d3fcd24.jpg not downloaded yet
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_62e9fc4e76874f0a7a3d7e98fb5312f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_62e9fc4e76874f0a7a3d7e98fb5312f4.jpg not downloaded yet
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa40c5d10>
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1acef5-aad0-5707-b995-cc1bd85f4d16/3f1acef5-aad0-5707-b995-cc1bd85f4d16_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F07%252F57075965bc2f5d3f86849fd03808fad4%252Fpa%252FVX51166_af6244ca0f658e7f9a2c34b99992709e.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_af6244ca0f658e7f9a2c34b99992709e.jpg saved to cache
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f1acef5-aad0-5707-b995-cc1bd85f4d16
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa435d750>
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_70cc9f133efa16b96883d5257d9a191c.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_70cc9f133efa16b96883d5257d9a191c.jpg saved to cache
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7851fcd-848f-552e-bb27-09862abc5ccc
2026-03-28 11:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_0e733a9065d97b24afdf195df125cb17.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:36 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-28 11:30:36 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-28 11:30:36 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-28 11:30:36 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-28 11:30:36 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG70738%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [auto1.be] INFO: Scrape type for XG70738: 1
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_bd7fc49169067cb9cf3fe08d7a6ed1c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_bd7fc49169067cb9cf3fe08d7a6ed1c8.jpg not downloaded yet
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fe2%252F10e27f5538436904f3ff1f90cdb1d832%252Fpa%252FHR69689_8f8faeb0504e97ad780a4dbbccdb6e1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_8f8faeb0504e97ad780a4dbbccdb6e1b.jpg not downloaded yet
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa6bc7390>
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb0e50d-5171-51f2-aac4-e266009560e3/ceb0e50d-5171-51f2-aac4-e266009560e3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F81%252F3881b810309754c5096e46d1a8d22dda%252Fpa%252FEK14732_155e33cf6262387f7ff83fcd4c248d55.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_155e33cf6262387f7ff83fcd4c248d55.jpg saved to cache
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ceb0e50d-5171-51f2-aac4-e266009560e3
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa418b9d0>
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8f9d8e-56d3-501a-a3bf-fd247e39458e/9b8f9d8e-56d3-501a-a3bf-fd247e39458e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F08%252Fe008542458bd80f5449a17a31e3862fc%252Fpa%252FUR02836_2a60496edd99a8478a8471f546f73dd9.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_2a60496edd99a8478a8471f546f73dd9.jpg saved to cache
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b8f9d8e-56d3-501a-a3bf-fd247e39458e
2026-03-28 11:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_28a6f87c7de0de1ef84a9cfc94377124.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_6426412e6605fca3d57438d129f3d7c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_6426412e6605fca3d57438d129f3d7c7.jpg not downloaded yet
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_d53019cebae7b1a94b2d61d53e31d871.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_d53019cebae7b1a94b2d61d53e31d871.jpg not downloaded yet
2026-03-28 11:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_4faccf71e553a2ba0a644377770e17c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_59c34f2b5b9e59547f0ba82e03ef4083.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:36 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-28 11:30:36 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV92885%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [auto1.be] INFO: Scrape type for GV92885: 1
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_c3abadbc83fdb1ffac240bb1fc6e259a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_c3abadbc83fdb1ffac240bb1fc6e259a.jpg not downloaded yet
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fe2%252F10e27f5538436904f3ff1f90cdb1d832%252Fpa%252FHR69689_c78124d96a5b8ac1c4df0b6f64e5292b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_c78124d96a5b8ac1c4df0b6f64e5292b.jpg not downloaded yet
2026-03-28 11:30:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:36 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1816 | hits on page: 40
2026-03-28 11:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db27fa81-3445-51c1-b94d-aaec429fceac with identifier: FC15884
2026-03-28 11:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db27fa81-3445-51c1-b94d-aaec429fceac with scrape type 1
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db27fa81-3445-51c1-b94d-aaec429fceac
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F67%252F2f676aaf15467c6fac1974f99dcd9876%252Fpa%252FFC15884_b89577bb0c962c007a63d496bc977dda.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_b89577bb0c962c007a63d496bc977dda.jpg already downloaded
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F67%252F2f676aaf15467c6fac1974f99dcd9876%252Fpa%252FFC15884_42bb711f78eaf1c9f7e014d4e3a4f572.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_42bb711f78eaf1c9f7e014d4e3a4f572.jpg already downloaded
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F67%252F2f676aaf15467c6fac1974f99dcd9876%252Fpa%252FFC15884_f1eda725d2c303d4ed9c4f95ed14912b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_f1eda725d2c303d4ed9c4f95ed14912b.jpg already downloaded
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F67%252F2f676aaf15467c6fac1974f99dcd9876%252Fpa%252FFC15884_267a9813c2999293d0e2efcb072a5f4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_267a9813c2999293d0e2efcb072a5f4c.jpg already downloaded
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F67%252F2f676aaf15467c6fac1974f99dcd9876%252Fpa%252FFC15884_abb72264cfdd52191463e75b067edab9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_abb72264cfdd52191463e75b067edab9.jpg already downloaded
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F67%252F2f676aaf15467c6fac1974f99dcd9876%252Fpa%252FFC15884_af50b67858642298111700cbc217e8b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_af50b67858642298111700cbc217e8b3.jpg already downloaded
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F67%252F2f676aaf15467c6fac1974f99dcd9876%252Fpa%252FFC15884_2479fb09935c70c3fdc22b8e2c9789c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_2479fb09935c70c3fdc22b8e2c9789c6.jpg already downloaded
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F67%252F2f676aaf15467c6fac1974f99dcd9876%252Fpa%252FFC15884_5c23904ab95b0350b32c816840cb4043.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_5c23904ab95b0350b32c816840cb4043.jpg already downloaded
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F67%252F2f676aaf15467c6fac1974f99dcd9876%252Fpa%252FFC15884_c69b0be83706ac24beea26dd86291018.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_c69b0be83706ac24beea26dd86291018.jpg already downloaded
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F67%252F2f676aaf15467c6fac1974f99dcd9876%252Fpa%252FFC15884_6286191189271877a8741ce7af2dba4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_6286191189271877a8741ce7af2dba4e.jpg already downloaded
2026-03-28 11:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db27fa81-3445-51c1-b94d-aaec429fceac, identifier: FC15884
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4470590>
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_dbd735fb73039cfedef119144807775b.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_dbd735fb73039cfedef119144807775b.jpg saved to cache
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef856ef4-db6c-5637-9d07-afdae111ee37
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_bd235ecdc9bcab12a290a5fa6a0f9868.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_bd235ecdc9bcab12a290a5fa6a0f9868.jpg not downloaded yet
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_d8d182eebade873b58a5c4feaec2bd78.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_d8d182eebade873b58a5c4feaec2bd78.jpg not downloaded yet
2026-03-28 11:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db27fa81-3445-51c1-b94d-aaec429fceac with identifier: FC15884
2026-03-28 11:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db27fa81-3445-51c1-b94d-aaec429fceac with identifier: FC15884
2026-03-28 11:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db27fa81-3445-51c1-b94d-aaec429fceac with identifier: FC15884 to the API
2026-03-28 11:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FC15884>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 144,
 'expiration_date': '2026-03-30T15:33:14Z',
 'fuel_type': 'diesel',
 'id': 'db27fa81-3445-51c1-b94d-aaec429fceac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC15884',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 31108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_b89577bb0c962c007a63d496bc977dda.jpg',
                'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_42bb711f78eaf1c9f7e014d4e3a4f572.jpg',
                'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_f1eda725d2c303d4ed9c4f95ed14912b.jpg',
                'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_267a9813c2999293d0e2efcb072a5f4c.jpg',
                'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_abb72264cfdd52191463e75b067edab9.jpg',
                'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_af50b67858642298111700cbc217e8b3.jpg',
                'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_2479fb09935c70c3fdc22b8e2c9789c6.jpg',
                'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_5c23904ab95b0350b32c816840cb4043.jpg',
                'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_c69b0be83706ac24beea26dd86291018.jpg',
                'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_6286191189271877a8741ce7af2dba4e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db27fa81-3445-51c1-b94d-aaec429fceac/db27fa81-3445-51c1-b94d-aaec429fceac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_b89577bb0c962c007a63d496bc977dda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db27fa81-3445-51c1-b94d-aaec429fceac/db27fa81-3445-51c1-b94d-aaec429fceac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_42bb711f78eaf1c9f7e014d4e3a4f572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db27fa81-3445-51c1-b94d-aaec429fceac/db27fa81-3445-51c1-b94d-aaec429fceac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_f1eda725d2c303d4ed9c4f95ed14912b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db27fa81-3445-51c1-b94d-aaec429fceac/db27fa81-3445-51c1-b94d-aaec429fceac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_267a9813c2999293d0e2efcb072a5f4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db27fa81-3445-51c1-b94d-aaec429fceac/db27fa81-3445-51c1-b94d-aaec429fceac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_abb72264cfdd52191463e75b067edab9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db27fa81-3445-51c1-b94d-aaec429fceac/db27fa81-3445-51c1-b94d-aaec429fceac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_af50b67858642298111700cbc217e8b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db27fa81-3445-51c1-b94d-aaec429fceac/db27fa81-3445-51c1-b94d-aaec429fceac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_2479fb09935c70c3fdc22b8e2c9789c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db27fa81-3445-51c1-b94d-aaec429fceac/db27fa81-3445-51c1-b94d-aaec429fceac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_5c23904ab95b0350b32c816840cb4043.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db27fa81-3445-51c1-b94d-aaec429fceac/db27fa81-3445-51c1-b94d-aaec429fceac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_c69b0be83706ac24beea26dd86291018.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db27fa81-3445-51c1-b94d-aaec429fceac/db27fa81-3445-51c1-b94d-aaec429fceac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/67/2f676aaf15467c6fac1974f99dcd9876/pa/FC15884_6286191189271877a8741ce7af2dba4e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Asphalt L3',
 'transmission': 'automatic',
 'trim': 'Asphalt L3',
 'year': 2022}
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC15884%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [auto1.be] INFO: Saving data for FC15884: {'created_time': 1774697437.203711, 'last_price_update_time': 1774697437.203722, 'auction_closing_time': 1774884794.0}
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC15884') HTTP/1.1" 204 0
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV83163%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [auto1.be] INFO: Scrape type for DV83163: 1
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fe2%252F10e27f5538436904f3ff1f90cdb1d832%252Fpa%252FHR69689_c2dd58f2a692d8b7833faeebb90964a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_c2dd58f2a692d8b7833faeebb90964a3.jpg not downloaded yet
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: VW85401
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU06988%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [auto1.be] INFO: Scrape type for CU06988: 1
2026-03-28 11:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_1a5ae42979b7ff394ab5347174e439e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_077e7e933f9633f95a15f3e1ea8130c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_f41f7e23032e0475aba67f93593521d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_8f90cfa9304f673db95dc4f7c719c848.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_8f90cfa9304f673db95dc4f7c719c848.jpg not downloaded yet
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_a18b87be1358e2910eb3c4d0c2f6fd37.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_a18b87be1358e2910eb3c4d0c2f6fd37.jpg not downloaded yet
2026-03-28 11:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4191810>
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8f9d8e-56d3-501a-a3bf-fd247e39458e/9b8f9d8e-56d3-501a-a3bf-fd247e39458e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F08%252Fe008542458bd80f5449a17a31e3862fc%252Fpa%252FUR02836_0e733a9065d97b24afdf195df125cb17.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_0e733a9065d97b24afdf195df125cb17.jpg saved to cache
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b8f9d8e-56d3-501a-a3bf-fd247e39458e
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4102e50>
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_28a6f87c7de0de1ef84a9cfc94377124.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_28a6f87c7de0de1ef84a9cfc94377124.jpg saved to cache
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa435dd50>
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_4faccf71e553a2ba0a644377770e17c6.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_4faccf71e553a2ba0a644377770e17c6.jpg saved to cache
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e8f110>
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_59c34f2b5b9e59547f0ba82e03ef4083.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_59c34f2b5b9e59547f0ba82e03ef4083.jpg saved to cache
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF15006%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [auto1.be] INFO: Scrape type for AF15006: 1
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: AV16828
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV16828%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [auto1.be] INFO: Scrape type for AV16828: 1
2026-03-28 11:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_9607f450d33d3c57327f4b9d10718c4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_61fe205e0d64e3571f0d614aefc1d9d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_61fe205e0d64e3571f0d614aefc1d9d7.jpg not downloaded yet
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_f6a57058e3f670f52af02c50222d92a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_f6a57058e3f670f52af02c50222d92a3.jpg not downloaded yet
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY19882%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [auto1.be] INFO: Scrape type for JY19882: 1
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH04328%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [auto1.be] INFO: Scrape type for KH04328: 1
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d81f90>
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8f9d8e-56d3-501a-a3bf-fd247e39458e/9b8f9d8e-56d3-501a-a3bf-fd247e39458e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F08%252Fe008542458bd80f5449a17a31e3862fc%252Fpa%252FUR02836_1a5ae42979b7ff394ab5347174e439e3.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_1a5ae42979b7ff394ab5347174e439e3.jpg saved to cache
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b8f9d8e-56d3-501a-a3bf-fd247e39458e
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa44011d0>
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_077e7e933f9633f95a15f3e1ea8130c6.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_077e7e933f9633f95a15f3e1ea8130c6.jpg saved to cache
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef856ef4-db6c-5637-9d07-afdae111ee37
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4210f50>
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_f41f7e23032e0475aba67f93593521d8.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_f41f7e23032e0475aba67f93593521d8.jpg saved to cache
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7851fcd-848f-552e-bb27-09862abc5ccc
2026-03-28 11:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_b42595d08f5cec511c959fd2a31a14fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_ca0ff2cd0853b96172e0e211a86ff47e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_ca0ff2cd0853b96172e0e211a86ff47e.jpg not downloaded yet
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_9df3176604e00e59cd5be6d772c175b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_9df3176604e00e59cd5be6d772c175b0.jpg not downloaded yet
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ80953%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [auto1.be] INFO: Scrape type for JZ80953: 1
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: MB27937
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN32494%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [auto1.be] INFO: Scrape type for GN32494: 1
2026-03-28 11:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_848dbe3e7efad41f284ab0c6ba2f9fb0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_5fceb675a1ed9cc207737df3e4d2a0cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_c115e1d87ae669cf39efd7c7a8f7a1b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_c115e1d87ae669cf39efd7c7a8f7a1b1.jpg not downloaded yet
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_5f90435ca49f3387118f7eeb8e44b867.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_5f90435ca49f3387118f7eeb8e44b867.jpg not downloaded yet
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4203010>
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8f9d8e-56d3-501a-a3bf-fd247e39458e/9b8f9d8e-56d3-501a-a3bf-fd247e39458e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F08%252Fe008542458bd80f5449a17a31e3862fc%252Fpa%252FUR02836_9607f450d33d3c57327f4b9d10718c4c.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_9607f450d33d3c57327f4b9d10718c4c.jpg saved to cache
2026-03-28 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b8f9d8e-56d3-501a-a3bf-fd247e39458e
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL44110%27 HTTP/1.1" 200 None
2026-03-28 11:30:37 [auto1.be] INFO: Scrape type for TL44110: 1
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-28 11:30:37 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA84805%27 HTTP/1.1" 200 None
2026-03-28 11:30:38 [auto1.be] INFO: Scrape type for LA84805: 1
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_03fd47a65539785ca6d2bd571da8a8a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_03fd47a65539785ca6d2bd571da8a8a4.jpg not downloaded yet
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_9e1d224d08aaac8989eb4192251b4d4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_9e1d224d08aaac8989eb4192251b4d4f.jpg not downloaded yet
2026-03-28 11:30:38 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-28 11:30:38 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC31614%27 HTTP/1.1" 200 None
2026-03-28 11:30:38 [auto1.be] INFO: Scrape type for FC31614: 1
2026-03-28 11:30:38 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-28 11:30:38 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX31058%27 HTTP/1.1" 200 None
2026-03-28 11:30:38 [auto1.be] INFO: Scrape type for RX31058: 1
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42bd3d0>
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6e0103-20c0-5073-8551-c220d276f1a5/7d6e0103-20c0-5073-8551-c220d276f1a5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fe2%252F10e27f5538436904f3ff1f90cdb1d832%252Fpa%252FHR69689_b42595d08f5cec511c959fd2a31a14fc.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_b42595d08f5cec511c959fd2a31a14fc.jpg saved to cache
2026-03-28 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d6e0103-20c0-5073-8551-c220d276f1a5
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_42712d80936d9c1e8db720279c21634b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_42712d80936d9c1e8db720279c21634b.jpg not downloaded yet
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_771fd1472fa9bc0b52287ecac45c1877.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_771fd1472fa9bc0b52287ecac45c1877.jpg not downloaded yet
2026-03-28 11:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_84df0d3bd1ff164a1add797e576ac03b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:38 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB55914%27 HTTP/1.1" 200 None
2026-03-28 11:30:38 [auto1.be] INFO: Scrape type for BB55914: 1
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4266750>
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_848dbe3e7efad41f284ab0c6ba2f9fb0.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_848dbe3e7efad41f284ab0c6ba2f9fb0.jpg saved to cache
2026-03-28 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4473ed0>
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6e0103-20c0-5073-8551-c220d276f1a5/7d6e0103-20c0-5073-8551-c220d276f1a5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fe2%252F10e27f5538436904f3ff1f90cdb1d832%252Fpa%252FHR69689_5fceb675a1ed9cc207737df3e4d2a0cd.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_5fceb675a1ed9cc207737df3e4d2a0cd.jpg saved to cache
2026-03-28 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d6e0103-20c0-5073-8551-c220d276f1a5
2026-03-28 11:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_bd7fc49169067cb9cf3fe08d7a6ed1c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:38 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-28 11:30:38 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-28 11:30:38 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC67497%27 HTTP/1.1" 200 None
2026-03-28 11:30:38 [auto1.be] INFO: Scrape type for KC67497: 1
2026-03-28 11:30:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_8f8faeb0504e97ad780a4dbbccdb6e1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:38 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-28 11:30:38 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-28 11:30:38 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-28 11:30:38 [auto1.be] INFO: Found listing with ID: US61346
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61346%27 HTTP/1.1" 200 None
2026-03-28 11:30:38 [auto1.be] INFO: Scrape type for US61346: 1
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa6efb310>
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6e0103-20c0-5073-8551-c220d276f1a5/7d6e0103-20c0-5073-8551-c220d276f1a5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fe2%252F10e27f5538436904f3ff1f90cdb1d832%252Fpa%252FHR69689_84df0d3bd1ff164a1add797e576ac03b.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_84df0d3bd1ff164a1add797e576ac03b.jpg saved to cache
2026-03-28 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d6e0103-20c0-5073-8551-c220d276f1a5
2026-03-28 11:30:38 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY12350%27 HTTP/1.1" 200 None
2026-03-28 11:30:38 [auto1.be] INFO: Scrape type for SY12350: 2
2026-03-28 11:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8b7998c-6bb7-5fb8-8c35-c4cae65a6464 with identifier: SY12350
2026-03-28 11:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b7998c-6bb7-5fb8-8c35-c4cae65a6464 with scrape type 2
2026-03-28 11:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8b7998c-6bb7-5fb8-8c35-c4cae65a6464 with scrape type 2
2026-03-28 11:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8b7998c-6bb7-5fb8-8c35-c4cae65a6464, identifier: SY12350
2026-03-28 11:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8b7998c-6bb7-5fb8-8c35-c4cae65a6464 with identifier: SY12350
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 11:30:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8b7998c-6bb7-5fb8-8c35-c4cae65a6464 with identifier: SY12350
2026-03-28 11:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8b7998c-6bb7-5fb8-8c35-c4cae65a6464 with identifier: SY12350 to the API
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:48:55Z',
 'fuel_type': 'diesel',
 'id': 'd8b7998c-6bb7-5fb8-8c35-c4cae65a6464',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY12350',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 171187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-18',
 'seller_name': None,
 'title': 'Opel Combo 1.3 CDTI Selection L1H1',
 'transmission': 'manual',
 'trim': 'Selection L1H1',
 'year': 2016}
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY12350%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Saving data for SY12350: {'auction_closing_time': 1774885735.0, 'created_time': 1773349212.952081, 'last_price_update_time': 1774697439.104287}
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SY12350') HTTP/1.1" 204 0
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST29091%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for ST29091: 1
2026-03-28 11:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_49a88004f6a858eefef46db4a7c3b249.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_bd235ecdc9bcab12a290a5fa6a0f9868.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_d8d182eebade873b58a5c4feaec2bd78.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_a18b87be1358e2910eb3c4d0c2f6fd37.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4339e10>
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_bd7fc49169067cb9cf3fe08d7a6ed1c8.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_bd7fc49169067cb9cf3fe08d7a6ed1c8.jpg saved to cache
2026-03-28 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4258c50>
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6e0103-20c0-5073-8551-c220d276f1a5/7d6e0103-20c0-5073-8551-c220d276f1a5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fe2%252F10e27f5538436904f3ff1f90cdb1d832%252Fpa%252FHR69689_8f8faeb0504e97ad780a4dbbccdb6e1b.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_8f8faeb0504e97ad780a4dbbccdb6e1b.jpg saved to cache
2026-03-28 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d6e0103-20c0-5073-8551-c220d276f1a5
2026-03-28 11:30:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV57254%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for TV57254: 1
2026-03-28 11:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG70738/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF01360%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for RF01360: 1
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU14069%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for UU14069: 1
2026-03-28 11:30:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d8a5d0>
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_49a88004f6a858eefef46db4a7c3b249.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_49a88004f6a858eefef46db4a7c3b249.jpg saved to cache
2026-03-28 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef856ef4-db6c-5637-9d07-afdae111ee37
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa6ed5ed0>
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_bd235ecdc9bcab12a290a5fa6a0f9868.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_bd235ecdc9bcab12a290a5fa6a0f9868.jpg saved to cache
2026-03-28 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9970f351-8e7b-5b05-806e-ef9f53ff2274
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4212250>
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_d8d182eebade873b58a5c4feaec2bd78.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_d8d182eebade873b58a5c4feaec2bd78.jpg saved to cache
2026-03-28 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa418da10>
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_a18b87be1358e2910eb3c4d0c2f6fd37.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_a18b87be1358e2910eb3c4d0c2f6fd37.jpg saved to cache
2026-03-28 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249
2026-03-28 11:30:39 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1816 | hits on page: 40
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78459%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for XG78459: 0
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25321%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for RC25321: 0
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ86935%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for YZ86935: 0
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB72565%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for XB72565: 0
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV46198%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for PV46198: 0
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU30240%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for RU30240: 0
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX22473%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for XX22473: 0
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA99172%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for YA99172: 0
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD03709%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for PD03709: 0
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ47401%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for HJ47401: 0
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY04920%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for WY04920: 0
2026-03-28 11:30:39 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG64643%27 HTTP/1.1" 200 None
2026-03-28 11:30:39 [auto1.be] INFO: Scrape type for PG64643: 2
2026-03-28 11:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14146459-2f14-56b5-a83d-8f42138ad58a with identifier: PG64643
2026-03-28 11:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14146459-2f14-56b5-a83d-8f42138ad58a with scrape type 2
2026-03-28 11:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14146459-2f14-56b5-a83d-8f42138ad58a with scrape type 2
2026-03-28 11:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 14146459-2f14-56b5-a83d-8f42138ad58a, identifier: PG64643
2026-03-28 11:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_56f4159fbda39d18afaea38464070edf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_ca0ff2cd0853b96172e0e211a86ff47e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_9df3176604e00e59cd5be6d772c175b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_771fd1472fa9bc0b52287ecac45c1877.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 14146459-2f14-56b5-a83d-8f42138ad58a with identifier: PG64643
2026-03-28 11:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 14146459-2f14-56b5-a83d-8f42138ad58a with identifier: PG64643
2026-03-28 11:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 14146459-2f14-56b5-a83d-8f42138ad58a with identifier: PG64643 to the API
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:56:51Z',
 'fuel_type': 'diesel',
 'id': '14146459-2f14-56b5-a83d-8f42138ad58a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG64643',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 120225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-11',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 Blue dCi Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2019}
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG64643%27 HTTP/1.1" 200 None
2026-03-28 11:30:40 [auto1.be] INFO: Saving data for PG64643: {'auction_closing_time': 1774886211.0, 'created_time': 1774513850.595762, 'last_price_update_time': 1774697440.359738}
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PG64643') HTTP/1.1" 204 0
2026-03-28 11:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:40 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-28 11:30:40 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-28 11:30:40 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV20794%27 HTTP/1.1" 200 None
2026-03-28 11:30:40 [auto1.be] INFO: Scrape type for PV20794: 0
2026-03-28 11:30:40 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-28 11:30:40 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-28 11:30:40 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ57770%27 HTTP/1.1" 200 None
2026-03-28 11:30:40 [auto1.be] INFO: Scrape type for SJ57770: 0
2026-03-28 11:30:40 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-28 11:30:40 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-28 11:30:40 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-28 11:30:40 [auto1.be] INFO: Scrape type for AB83336: 0
2026-03-28 11:30:40 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR34349%27 HTTP/1.1" 200 None
2026-03-28 11:30:40 [auto1.be] INFO: Scrape type for MR34349: 0
2026-03-28 11:30:40 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-28 11:30:40 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-28 11:30:40 [auto1.be] INFO: Scrape type for UW48636: 2
2026-03-28 11:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7852e0b3-eec8-5486-b88c-ebf6b08d12e9 with identifier: UW48636
2026-03-28 11:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7852e0b3-eec8-5486-b88c-ebf6b08d12e9 with scrape type 2
2026-03-28 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7852e0b3-eec8-5486-b88c-ebf6b08d12e9 with scrape type 2
2026-03-28 11:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7852e0b3-eec8-5486-b88c-ebf6b08d12e9, identifier: UW48636
2026-03-28 11:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7852e0b3-eec8-5486-b88c-ebf6b08d12e9 with identifier: UW48636
2026-03-28 11:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7852e0b3-eec8-5486-b88c-ebf6b08d12e9 with identifier: UW48636
2026-03-28 11:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7852e0b3-eec8-5486-b88c-ebf6b08d12e9 with identifier: UW48636 to the API
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:32:44Z',
 'fuel_type': 'diesel',
 'id': '7852e0b3-eec8-5486-b88c-ebf6b08d12e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW48636',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 85399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-30',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2013}
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-28 11:30:40 [auto1.be] INFO: Saving data for UW48636: {'auction_closing_time': 1774884764.0, 'created_time': 1774513852.024721, 'last_price_update_time': 1774697440.973166}
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UW48636') HTTP/1.1" 204 0
2026-03-28 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB55914/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:41 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-28 11:30:41 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA69116%27 HTTP/1.1" 200 None
2026-03-28 11:30:41 [auto1.be] INFO: Scrape type for YA69116: 0
2026-03-28 11:30:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_9e1d224d08aaac8989eb4192251b4d4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa44603d0>
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_56f4159fbda39d18afaea38464070edf.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_56f4159fbda39d18afaea38464070edf.jpg saved to cache
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef856ef4-db6c-5637-9d07-afdae111ee37
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4426650>
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_ca0ff2cd0853b96172e0e211a86ff47e.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_ca0ff2cd0853b96172e0e211a86ff47e.jpg saved to cache
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9970f351-8e7b-5b05-806e-ef9f53ff2274
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e3af10>
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_9df3176604e00e59cd5be6d772c175b0.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_9df3176604e00e59cd5be6d772c175b0.jpg saved to cache
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4411810>
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_771fd1472fa9bc0b52287ecac45c1877.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_771fd1472fa9bc0b52287ecac45c1877.jpg saved to cache
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249
2026-03-28 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_dc10cb7c2efed4385b8f4ab37e9e6718.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_52d2a00f2da223c2b783ed0051d938a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa44ac890>
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_9e1d224d08aaac8989eb4192251b4d4f.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_9e1d224d08aaac8989eb4192251b4d4f.jpg saved to cache
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249
2026-03-28 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_d88a48376440da4bd0bd7e8379c82623.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_42712d80936d9c1e8db720279c21634b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_f6a57058e3f670f52af02c50222d92a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e06a90>
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_dc10cb7c2efed4385b8f4ab37e9e6718.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_dc10cb7c2efed4385b8f4ab37e9e6718.jpg saved to cache
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef856ef4-db6c-5637-9d07-afdae111ee37
2026-03-28 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_03fd47a65539785ca6d2bd571da8a8a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4173310>
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_52d2a00f2da223c2b783ed0051d938a8.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_52d2a00f2da223c2b783ed0051d938a8.jpg saved to cache
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7851fcd-848f-552e-bb27-09862abc5ccc
2026-03-28 11:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa430ba10>
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_d88a48376440da4bd0bd7e8379c82623.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_d88a48376440da4bd0bd7e8379c82623.jpg saved to cache
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249
2026-03-28 11:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41a8a10>
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_42712d80936d9c1e8db720279c21634b.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_42712d80936d9c1e8db720279c21634b.jpg saved to cache
2026-03-28 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9970f351-8e7b-5b05-806e-ef9f53ff2274
2026-03-28 11:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa44a6d10>
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_f6a57058e3f670f52af02c50222d92a3.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_f6a57058e3f670f52af02c50222d92a3.jpg saved to cache
2026-03-28 11:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249
2026-03-28 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC31614/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX31058/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41aae50>
2026-03-28 11:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_03fd47a65539785ca6d2bd571da8a8a4.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_03fd47a65539785ca6d2bd571da8a8a4.jpg saved to cache
2026-03-28 11:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9970f351-8e7b-5b05-806e-ef9f53ff2274
2026-03-28 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST29091/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US61346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_c115e1d87ae669cf39efd7c7a8f7a1b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC67497/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_5f90435ca49f3387118f7eeb8e44b867.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:42 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1816 | hits on page: 40
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for JD01885: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for PL61351: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: YX19447
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX19447%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for YX19447: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for YN02015: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for EZ55101: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for MK20825: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for GK88228: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for WV47829: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: KX87020
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX87020%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for KX87020: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: AK97810
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK97810%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for AK97810: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: BA79285
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: ZH21985
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: WX93406
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: TU23478
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: ET15377
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET15377%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for ET15377: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: NH68811
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: UB07200
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB07200%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for UB07200: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: SK39898
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for JK00802: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: PZ36955
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ36955%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for PZ36955: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: NY11434
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: XE88192
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: ZN43275
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN43275%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for ZN43275: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: AV76677
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV76677%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for AV76677: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for BA37972: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: JN48445
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN48445%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for JN48445: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: FU55081
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: RB14392
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: MY55708
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: XK15851
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: AU94213
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU94213%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for AU94213: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: AM90339
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM90339%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for AM90339: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for FF69776: 0
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: TA93870
2026-03-28 11:30:42 [auto1.be] INFO: Found listing with ID: ZR94706
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR94706%27 HTTP/1.1" 200 None
2026-03-28 11:30:42 [auto1.be] INFO: Scrape type for ZR94706: 0
2026-03-28 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU14069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4316510>
2026-03-28 11:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_c115e1d87ae669cf39efd7c7a8f7a1b1.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_c115e1d87ae669cf39efd7c7a8f7a1b1.jpg saved to cache
2026-03-28 11:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9970f351-8e7b-5b05-806e-ef9f53ff2274
2026-03-28 11:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4210f10>
2026-03-28 11:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_5f90435ca49f3387118f7eeb8e44b867.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_5f90435ca49f3387118f7eeb8e44b867.jpg saved to cache
2026-03-28 11:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249
2026-03-28 11:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_61fe205e0d64e3571f0d614aefc1d9d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF01360/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa425a250>
2026-03-28 11:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_61fe205e0d64e3571f0d614aefc1d9d7.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_61fe205e0d64e3571f0d614aefc1d9d7.jpg saved to cache
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9970f351-8e7b-5b05-806e-ef9f53ff2274
2026-03-28 11:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA84805/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG70738> (referer: https://www.auto1.com/v1/car-details-view/XG70738/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN32494/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV57254/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4348a1dc-8057-530c-a3dd-516db4e90c09 with identifier: XG70738
2026-03-28 11:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4348a1dc-8057-530c-a3dd-516db4e90c09 with scrape type 1
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4348a1dc-8057-530c-a3dd-516db4e90c09
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_211cb053f601c08f5a55faa0c9f7cdf6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_211cb053f601c08f5a55faa0c9f7cdf6.jpg not downloaded yet
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_26636feaf2a49ef97a46de54d149c3a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_26636feaf2a49ef97a46de54d149c3a0.jpg not downloaded yet
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_5790c3a1f65f88e7945b994b8e16c81d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_5790c3a1f65f88e7945b994b8e16c81d.jpg not downloaded yet
2026-03-28 11:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB55914> (referer: https://www.auto1.com/v1/car-details-view/BB55914/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_73434a772e733f5b7f31e5959c30c854.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_73434a772e733f5b7f31e5959c30c854.jpg not downloaded yet
2026-03-28 11:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_240509a80766a54da06ec44b37fea245.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_240509a80766a54da06ec44b37fea245.jpg not downloaded yet
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_ed3f7f0b30f06dbed239c3cd34999879.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_ed3f7f0b30f06dbed239c3cd34999879.jpg not downloaded yet
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_0509085e6137e071cb032bd90f27319c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_0509085e6137e071cb032bd90f27319c.jpg not downloaded yet
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_66718e161f74e641136230be0340a0c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_66718e161f74e641136230be0340a0c9.jpg not downloaded yet
2026-03-28 11:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH04328/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_20c27bfe5316f5e6473bb3607cd3c897.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_20c27bfe5316f5e6473bb3607cd3c897.jpg not downloaded yet
2026-03-28 11:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_a6741eee6d6ca1eadf833444ead3f0df.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_a6741eee6d6ca1eadf833444ead3f0df.jpg not downloaded yet
2026-03-28 11:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55ab384c-2a36-59f4-a817-e36c5a40c743 with identifier: BB55914
2026-03-28 11:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55ab384c-2a36-59f4-a817-e36c5a40c743 with scrape type 1
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55ab384c-2a36-59f4-a817-e36c5a40c743
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_c685d027391d6fc16fb692216249c2f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_c685d027391d6fc16fb692216249c2f9.jpg not downloaded yet
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_39b450b3b0d5edb0ad5dd734b8c03e10.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_39b450b3b0d5edb0ad5dd734b8c03e10.jpg not downloaded yet
2026-03-28 11:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ80953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_ed3227dabb20510766bfa70c1fb289fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_ed3227dabb20510766bfa70c1fb289fc.jpg not downloaded yet
2026-03-28 11:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_5790c3a1f65f88e7945b994b8e16c81d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_7d0ed2438a89539e09fb11fb5bef7852.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_7d0ed2438a89539e09fb11fb5bef7852.jpg not downloaded yet
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_8e430541660d9f596179d008183a51d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_8e430541660d9f596179d008183a51d9.jpg not downloaded yet
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_f41e8c95909bc98e515e71eec1e3f792.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_f41e8c95909bc98e515e71eec1e3f792.jpg not downloaded yet
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_8663d702d942438aa3a0c3d347dad47c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_8663d702d942438aa3a0c3d347dad47c.jpg not downloaded yet
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_bc7681a2a2e0b0dfae812d67272e9d85.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_bc7681a2a2e0b0dfae812d67272e9d85.jpg not downloaded yet
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_ef4acd5f360923478e7aaee64d0f70ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_ef4acd5f360923478e7aaee64d0f70ee.jpg not downloaded yet
2026-03-28 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_66718e161f74e641136230be0340a0c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_64dbf2959885298cc75a63b3e64ba866.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_64dbf2959885298cc75a63b3e64ba866.jpg not downloaded yet
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa449d9d0>
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_5790c3a1f65f88e7945b994b8e16c81d.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_5790c3a1f65f88e7945b994b8e16c81d.jpg saved to cache
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4348a1dc-8057-530c-a3dd-516db4e90c09
2026-03-28 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY19882/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_ed3227dabb20510766bfa70c1fb289fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_39b450b3b0d5edb0ad5dd734b8c03e10.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42ee250>
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_66718e161f74e641136230be0340a0c9.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_66718e161f74e641136230be0340a0c9.jpg saved to cache
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4348a1dc-8057-530c-a3dd-516db4e90c09
2026-03-28 11:30:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa411e590>
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_ed3227dabb20510766bfa70c1fb289fc.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_ed3227dabb20510766bfa70c1fb289fc.jpg saved to cache
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55ab384c-2a36-59f4-a817-e36c5a40c743
2026-03-28 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_64dbf2959885298cc75a63b3e64ba866.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_ef4acd5f360923478e7aaee64d0f70ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4427b90>
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_39b450b3b0d5edb0ad5dd734b8c03e10.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_39b450b3b0d5edb0ad5dd734b8c03e10.jpg saved to cache
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55ab384c-2a36-59f4-a817-e36c5a40c743
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42027d0>
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_64dbf2959885298cc75a63b3e64ba866.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_64dbf2959885298cc75a63b3e64ba866.jpg saved to cache
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55ab384c-2a36-59f4-a817-e36c5a40c743
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa446a650>
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_ef4acd5f360923478e7aaee64d0f70ee.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_ef4acd5f360923478e7aaee64d0f70ee.jpg saved to cache
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55ab384c-2a36-59f4-a817-e36c5a40c743
2026-03-28 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_bc7681a2a2e0b0dfae812d67272e9d85.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST29091> (referer: https://www.auto1.com/v1/car-details-view/ST29091/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC31614> (referer: https://www.auto1.com/v1/car-details-view/FC31614/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e2fc10>
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_bc7681a2a2e0b0dfae812d67272e9d85.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_bc7681a2a2e0b0dfae812d67272e9d85.jpg saved to cache
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55ab384c-2a36-59f4-a817-e36c5a40c743
2026-03-28 11:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b72da8e-378d-5b38-bbba-a33071818563 with identifier: ST29091
2026-03-28 11:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b72da8e-378d-5b38-bbba-a33071818563 with scrape type 1
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b72da8e-378d-5b38-bbba-a33071818563
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_45b3ac13d7826f934c74076093dff3d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_45b3ac13d7826f934c74076093dff3d2.jpg not downloaded yet
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_9f4b3abee180cd75fb14607b607203a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_9f4b3abee180cd75fb14607b607203a0.jpg not downloaded yet
2026-03-28 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV16828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_4f8e4e7050273f6c7fa2ed17487de39e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_4f8e4e7050273f6c7fa2ed17487de39e.jpg not downloaded yet
2026-03-28 11:30:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c308775-4db8-55d1-af91-dc9daebcc7bf with identifier: FC31614
2026-03-28 11:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c308775-4db8-55d1-af91-dc9daebcc7bf with scrape type 1
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c308775-4db8-55d1-af91-dc9daebcc7bf
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_8a79e476dcbcc1620ad178be9dedaaf6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_8a79e476dcbcc1620ad178be9dedaaf6.jpg not downloaded yet
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_67a313f2ae624e76bf1ea3081dd76b14.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_67a313f2ae624e76bf1ea3081dd76b14.jpg not downloaded yet
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_1a565def4e55d7bb8a0be79b522d7ff1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_1a565def4e55d7bb8a0be79b522d7ff1.jpg not downloaded yet
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_97280cee7cbfa96a44815fef57ba6022.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_97280cee7cbfa96a44815fef57ba6022.jpg not downloaded yet
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_3811d0a2d0500dde47a8a25dc455601a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_3811d0a2d0500dde47a8a25dc455601a.jpg not downloaded yet
2026-03-28 11:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_dee88b2ed8b44ad536c93f20ede21b68.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_dee88b2ed8b44ad536c93f20ede21b68.jpg not downloaded yet
2026-03-28 11:30:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_7113cab526fe7e24d966013b1bca0487.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_7113cab526fe7e24d966013b1bca0487.jpg not downloaded yet
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_1c61f7394557fef72bd806bd4e2dc843.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_1c61f7394557fef72bd806bd4e2dc843.jpg not downloaded yet
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_95b8b71c8f0b5352d3d4aefb2a56b7cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_95b8b71c8f0b5352d3d4aefb2a56b7cc.jpg not downloaded yet
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_18e718ce35658d86e2a161913d98ea5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_18e718ce35658d86e2a161913d98ea5f.jpg not downloaded yet
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_5313836615149d50c68f4e24394ee0af.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_5313836615149d50c68f4e24394ee0af.jpg not downloaded yet
2026-03-28 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU14069> (referer: https://www.auto1.com/v1/car-details-view/UU14069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_97280cee7cbfa96a44815fef57ba6022.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_1cec35cc0351ce0f8042c1424d494d75.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_1cec35cc0351ce0f8042c1424d494d75.jpg not downloaded yet
2026-03-28 11:30:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_d31f0722224d8588fc21578fb158d280.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_d31f0722224d8588fc21578fb158d280.jpg not downloaded yet
2026-03-28 11:30:45 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1816 | hits on page: 40
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_74b34a6118e04e9e5138f0928837ef4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_74b34a6118e04e9e5138f0928837ef4e.jpg not downloaded yet
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_3ec16a9758e2e2fe366016cbfc1329be.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_3ec16a9758e2e2fe366016cbfc1329be.jpg not downloaded yet
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: XL14792
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL14792%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for XL14792: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: JF06459
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for MK30308: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL42374%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for KL42374: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: YX04122
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX04122%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for YX04122: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: PZ99747
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: XX88636
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX88636%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for XX88636: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: CH97070
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH97070%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for CH97070: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: TB53896
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: PL30549
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: JB83669
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB83669%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for JB83669: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: FD92001
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD92001%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for FD92001: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: LN19500
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LN19500%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for LN19500: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL91929%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for EL91929: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: KS47676
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: KU28222
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: AY67294
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY67294%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for AY67294: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: LN33262
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: HH92920
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH92920%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for HH92920: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: FD47610
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD47610%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for FD47610: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: YM92505
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM92505%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for YM92505: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: YA41293
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA41293%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for YA41293: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for ZS70359: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: WX65816
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX65816%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for WX65816: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for PR31064: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: YR74794
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR74794%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for YR74794: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: XC85996
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for LL08256: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for FL46625: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for BT72678: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for CE58685: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [auto1.be] INFO: Scrape type for ND78338: 0
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-28 11:30:45 [auto1.be] INFO: Found listing with ID: EZ92638
2026-03-28 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_18e718ce35658d86e2a161913d98ea5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_ff06bf40baea1f1f963f6c87f328389f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_ff06bf40baea1f1f963f6c87f328389f.jpg not downloaded yet
2026-03-28 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_5313836615149d50c68f4e24394ee0af.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ffbf2b1-14dd-5735-8e53-bae43c978d2a with identifier: UU14069
2026-03-28 11:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a with scrape type 1
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_12c92904fded2eab1498444025bf2d38.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_12c92904fded2eab1498444025bf2d38.jpg not downloaded yet
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4213f90>
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_97280cee7cbfa96a44815fef57ba6022.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_97280cee7cbfa96a44815fef57ba6022.jpg saved to cache
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b72da8e-378d-5b38-bbba-a33071818563
2026-03-28 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_8e430541660d9f596179d008183a51d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_ccd3d6ff9d14aba62e347225bb819856.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_ccd3d6ff9d14aba62e347225bb819856.jpg not downloaded yet
2026-03-28 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_8663d702d942438aa3a0c3d347dad47c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_37934075ca58bfdff7af8cd74709a295.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_37934075ca58bfdff7af8cd74709a295.jpg not downloaded yet
2026-03-28 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF01360> (referer: https://www.auto1.com/v1/car-details-view/RF01360/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC67497> (referer: https://www.auto1.com/v1/car-details-view/KC67497/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_3093f74b96ec9c2c45bf47a57a182087.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_3093f74b96ec9c2c45bf47a57a182087.jpg not downloaded yet
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e5bed0>
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_18e718ce35658d86e2a161913d98ea5f.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_18e718ce35658d86e2a161913d98ea5f.jpg saved to cache
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b72da8e-378d-5b38-bbba-a33071818563
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4224e90>
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_5313836615149d50c68f4e24394ee0af.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_5313836615149d50c68f4e24394ee0af.jpg saved to cache
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c308775-4db8-55d1-af91-dc9daebcc7bf
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_271a285a7375008f9497ac668e4a8eaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_271a285a7375008f9497ac668e4a8eaf.jpg not downloaded yet
2026-03-28 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_74b34a6118e04e9e5138f0928837ef4e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX31058> (referer: https://www.auto1.com/v1/car-details-view/RX31058/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_69c71fbca070b1e9b4878c2266d3f2b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_69c71fbca070b1e9b4878c2266d3f2b9.jpg not downloaded yet
2026-03-28 11:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA84805> (referer: https://www.auto1.com/v1/car-details-view/LA84805/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa446b750>
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_8e430541660d9f596179d008183a51d9.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_8e430541660d9f596179d008183a51d9.jpg saved to cache
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55ab384c-2a36-59f4-a817-e36c5a40c743
2026-03-28 11:30:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa6ef5e10>
2026-03-28 11:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_8663d702d942438aa3a0c3d347dad47c.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_8663d702d942438aa3a0c3d347dad47c.jpg saved to cache
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55ab384c-2a36-59f4-a817-e36c5a40c743
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_ebc0f21fe1adacb89c3d6e4cd5ef2678.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_ebc0f21fe1adacb89c3d6e4cd5ef2678.jpg not downloaded yet
2026-03-28 11:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d927ef0d-1f06-57f7-8d01-f304e031bd35 with identifier: RF01360
2026-03-28 11:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d927ef0d-1f06-57f7-8d01-f304e031bd35 with scrape type 1
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d927ef0d-1f06-57f7-8d01-f304e031bd35
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_97255c87445fc98e51ee1492ef1be37c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_97255c87445fc98e51ee1492ef1be37c.jpg not downloaded yet
2026-03-28 11:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b42d776-915d-5179-afd8-c2d3d89179cf with identifier: KC67497
2026-03-28 11:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b42d776-915d-5179-afd8-c2d3d89179cf with scrape type 1
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b42d776-915d-5179-afd8-c2d3d89179cf
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_1238f5ee79344947cd64d27086f8db46.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_1238f5ee79344947cd64d27086f8db46.jpg not downloaded yet
2026-03-28 11:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_f41e8c95909bc98e515e71eec1e3f792.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_ff06bf40baea1f1f963f6c87f328389f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_3ec16a9758e2e2fe366016cbfc1329be.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_2003dcd9ebe31e6fe8f0f5dca0c5cc8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_2003dcd9ebe31e6fe8f0f5dca0c5cc8f.jpg not downloaded yet
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_7bd1c372209637490877d057684e8e9b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_7bd1c372209637490877d057684e8e9b.jpg not downloaded yet
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_aa6bacc5f6f940ad5d24f0ea14a8d429.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_aa6bacc5f6f940ad5d24f0ea14a8d429.jpg not downloaded yet
2026-03-28 11:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa40fa650>
2026-03-28 11:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_74b34a6118e04e9e5138f0928837ef4e.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_74b34a6118e04e9e5138f0928837ef4e.jpg saved to cache
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b72da8e-378d-5b38-bbba-a33071818563
2026-03-28 11:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 708665a9-0358-5916-ac8f-c4940f6c0658 with identifier: RX31058
2026-03-28 11:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 708665a9-0358-5916-ac8f-c4940f6c0658 with scrape type 1
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 708665a9-0358-5916-ac8f-c4940f6c0658
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_4f1725f801715401ff401052eb883d8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_4f1725f801715401ff401052eb883d8a.jpg not downloaded yet
2026-03-28 11:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39f96baf-e76a-579c-9f6e-af39879cc09c with identifier: LA84805
2026-03-28 11:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39f96baf-e76a-579c-9f6e-af39879cc09c with scrape type 1
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39f96baf-e76a-579c-9f6e-af39879cc09c
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F3e%252F403e2c9786c28683a5d1d996b2b5950b%252Fpa%252FLA84805_74a20508f540e12663bb87027358b8d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_74a20508f540e12663bb87027358b8d0.jpg already downloaded
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F3e%252F403e2c9786c28683a5d1d996b2b5950b%252Fpa%252FLA84805_e9e6a7bd7215767ea78098680630f582.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_e9e6a7bd7215767ea78098680630f582.jpg already downloaded
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F3e%252F403e2c9786c28683a5d1d996b2b5950b%252Fpa%252FLA84805_8ac1a6bba697f50b6bc56799658d71a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_8ac1a6bba697f50b6bc56799658d71a3.jpg already downloaded
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F3e%252F403e2c9786c28683a5d1d996b2b5950b%252Fpa%252FLA84805_ee5b40eeba95730db8b8fe199793ad2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_ee5b40eeba95730db8b8fe199793ad2c.jpg already downloaded
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F3e%252F403e2c9786c28683a5d1d996b2b5950b%252Fpa%252FLA84805_d30ca2721df2243cf41e6f2180507024.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_d30ca2721df2243cf41e6f2180507024.jpg already downloaded
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F3e%252F403e2c9786c28683a5d1d996b2b5950b%252Fpa%252FLA84805_cee3839da852fb881c5b6e7ceb8f0934.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_cee3839da852fb881c5b6e7ceb8f0934.jpg already downloaded
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F3e%252F403e2c9786c28683a5d1d996b2b5950b%252Fpa%252FLA84805_27ce064d98a2ed03634f0c09f66aaa1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_27ce064d98a2ed03634f0c09f66aaa1b.jpg already downloaded
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F3e%252F403e2c9786c28683a5d1d996b2b5950b%252Fpa%252FLA84805_7c4cf711988805e5ccdfaa9630ff0ebb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_7c4cf711988805e5ccdfaa9630ff0ebb.jpg already downloaded
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F3e%252F403e2c9786c28683a5d1d996b2b5950b%252Fpa%252FLA84805_4967371a6f13f686124778f6ec59f50e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_4967371a6f13f686124778f6ec59f50e.jpg already downloaded
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F3e%252F403e2c9786c28683a5d1d996b2b5950b%252Fpa%252FLA84805_b28f1990469737832d4530e25e14fda3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_b28f1990469737832d4530e25e14fda3.jpg already downloaded
2026-03-28 11:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 39f96baf-e76a-579c-9f6e-af39879cc09c, identifier: LA84805
2026-03-28 11:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 39f96baf-e76a-579c-9f6e-af39879cc09c with identifier: LA84805
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 11:30:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 39f96baf-e76a-579c-9f6e-af39879cc09c with identifier: LA84805
2026-03-28 11:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 39f96baf-e76a-579c-9f6e-af39879cc09c with identifier: LA84805 to the API
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LA84805>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:59:53Z',
 'fuel_type': 'diesel',
 'id': '39f96baf-e76a-579c-9f6e-af39879cc09c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA84805',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 216757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_74a20508f540e12663bb87027358b8d0.jpg',
                'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_e9e6a7bd7215767ea78098680630f582.jpg',
                'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_8ac1a6bba697f50b6bc56799658d71a3.jpg',
                'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_ee5b40eeba95730db8b8fe199793ad2c.jpg',
                'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_d30ca2721df2243cf41e6f2180507024.jpg',
                'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_cee3839da852fb881c5b6e7ceb8f0934.jpg',
                'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_27ce064d98a2ed03634f0c09f66aaa1b.jpg',
                'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_7c4cf711988805e5ccdfaa9630ff0ebb.jpg',
                'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_4967371a6f13f686124778f6ec59f50e.jpg',
                'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_b28f1990469737832d4530e25e14fda3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f96baf-e76a-579c-9f6e-af39879cc09c/39f96baf-e76a-579c-9f6e-af39879cc09c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_74a20508f540e12663bb87027358b8d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f96baf-e76a-579c-9f6e-af39879cc09c/39f96baf-e76a-579c-9f6e-af39879cc09c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_e9e6a7bd7215767ea78098680630f582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f96baf-e76a-579c-9f6e-af39879cc09c/39f96baf-e76a-579c-9f6e-af39879cc09c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_8ac1a6bba697f50b6bc56799658d71a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f96baf-e76a-579c-9f6e-af39879cc09c/39f96baf-e76a-579c-9f6e-af39879cc09c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_ee5b40eeba95730db8b8fe199793ad2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f96baf-e76a-579c-9f6e-af39879cc09c/39f96baf-e76a-579c-9f6e-af39879cc09c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_d30ca2721df2243cf41e6f2180507024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f96baf-e76a-579c-9f6e-af39879cc09c/39f96baf-e76a-579c-9f6e-af39879cc09c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_cee3839da852fb881c5b6e7ceb8f0934.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f96baf-e76a-579c-9f6e-af39879cc09c/39f96baf-e76a-579c-9f6e-af39879cc09c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_27ce064d98a2ed03634f0c09f66aaa1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f96baf-e76a-579c-9f6e-af39879cc09c/39f96baf-e76a-579c-9f6e-af39879cc09c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_7c4cf711988805e5ccdfaa9630ff0ebb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f96baf-e76a-579c-9f6e-af39879cc09c/39f96baf-e76a-579c-9f6e-af39879cc09c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_4967371a6f13f686124778f6ec59f50e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f96baf-e76a-579c-9f6e-af39879cc09c/39f96baf-e76a-579c-9f6e-af39879cc09c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/3e/403e2c9786c28683a5d1d996b2b5950b/pa/LA84805_b28f1990469737832d4530e25e14fda3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Kinetic 2WD',
 'transmission': 'automatic',
 'trim': 'Kinetic 2WD',
 'year': 2012}
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA84805%27 HTTP/1.1" 200 None
2026-03-28 11:30:47 [auto1.be] INFO: Saving data for LA84805: {'created_time': 1774697447.532682, 'last_price_update_time': 1774697447.532696, 'auction_closing_time': 1774886393.0}
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LA84805') HTTP/1.1" 204 0
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_e9c4bb65bcf913dc89e0cb661ca664aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_e9c4bb65bcf913dc89e0cb661ca664aa.jpg not downloaded yet
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_cf2d9959a11607f3223269e690ffe8a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_cf2d9959a11607f3223269e690ffe8a8.jpg not downloaded yet
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_f92e74a952a959cdf6516cd5c79cd681.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_f92e74a952a959cdf6516cd5c79cd681.jpg not downloaded yet
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_a4e3fb405658514685d3321880c68802.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_a4e3fb405658514685d3321880c68802.jpg not downloaded yet
2026-03-28 11:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF15006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US61346> (referer: https://www.auto1.com/v1/car-details-view/US61346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4369790>
2026-03-28 11:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_f41e8c95909bc98e515e71eec1e3f792.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_f41e8c95909bc98e515e71eec1e3f792.jpg saved to cache
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55ab384c-2a36-59f4-a817-e36c5a40c743
2026-03-28 11:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4389110>
2026-03-28 11:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_ff06bf40baea1f1f963f6c87f328389f.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_ff06bf40baea1f1f963f6c87f328389f.jpg saved to cache
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c308775-4db8-55d1-af91-dc9daebcc7bf
2026-03-28 11:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa433ecd0>
2026-03-28 11:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_3ec16a9758e2e2fe366016cbfc1329be.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_3ec16a9758e2e2fe366016cbfc1329be.jpg saved to cache
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c308775-4db8-55d1-af91-dc9daebcc7bf
2026-03-28 11:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_7d0ed2438a89539e09fb11fb5bef7852.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_12c92904fded2eab1498444025bf2d38.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_3093f74b96ec9c2c45bf47a57a182087.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_ccd3d6ff9d14aba62e347225bb819856.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_2edf8db05c60f934a544f4e5142a0631.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_2edf8db05c60f934a544f4e5142a0631.jpg not downloaded yet
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_83cac5a8574834062eefbe2a884ba22a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_83cac5a8574834062eefbe2a884ba22a.jpg not downloaded yet
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_7240ae62271b9bb74d1637470d86c23c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_7240ae62271b9bb74d1637470d86c23c.jpg not downloaded yet
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_aa9579863e6d675a1eacfc7def04514e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_aa9579863e6d675a1eacfc7def04514e.jpg not downloaded yet
2026-03-28 11:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ80953> (referer: https://www.auto1.com/v1/car-details-view/JZ80953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_f2c8b252dcd69bfa61d458e82a9caebb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_f2c8b252dcd69bfa61d458e82a9caebb.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_55e86dd84fa1457132cc5d1e73d07bae.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_55e86dd84fa1457132cc5d1e73d07bae.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_39aaeac74692bfc6b84c18e0801e0028.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_39aaeac74692bfc6b84c18e0801e0028.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_13f7f4f190b74389b4bf1263b1ae9492.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_13f7f4f190b74389b4bf1263b1ae9492.jpg not downloaded yet
2026-03-28 11:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ad5b7d-f068-51af-b4b4-d8d71d053aff with identifier: US61346
2026-03-28 11:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff with scrape type 1
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_f7cabe53b3f2e692729fd39e404752a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_f7cabe53b3f2e692729fd39e404752a7.jpg not downloaded yet
2026-03-28 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_1cec35cc0351ce0f8042c1424d494d75.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_795784fe8e19048cbc7d4a9b5458cb54.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_795784fe8e19048cbc7d4a9b5458cb54.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_694ce225d40eb9819ed47a727a95793a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_694ce225d40eb9819ed47a727a95793a.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_5785011febbd8e395d8fbb9cb951e93e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_5785011febbd8e395d8fbb9cb951e93e.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_7a2c78a4b3819ef412d90cdf2e464bfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_7a2c78a4b3819ef412d90cdf2e464bfd.jpg not downloaded yet
2026-03-28 11:30:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42ecd90>
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_7d0ed2438a89539e09fb11fb5bef7852.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_7d0ed2438a89539e09fb11fb5bef7852.jpg saved to cache
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55ab384c-2a36-59f4-a817-e36c5a40c743
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa439eed0>
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_12c92904fded2eab1498444025bf2d38.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_12c92904fded2eab1498444025bf2d38.jpg saved to cache
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa432f710>
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_3093f74b96ec9c2c45bf47a57a182087.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_3093f74b96ec9c2c45bf47a57a182087.jpg saved to cache
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e2d650>
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_ccd3d6ff9d14aba62e347225bb819856.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_ccd3d6ff9d14aba62e347225bb819856.jpg saved to cache
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c308775-4db8-55d1-af91-dc9daebcc7bf
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_157a90bf6d894c2998b9f804089fe2d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_157a90bf6d894c2998b9f804089fe2d6.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_a731adc292ba09b2308d91769c3dec5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_a731adc292ba09b2308d91769c3dec5b.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_9447ccf0d7b87f48fb415022051d6150.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_9447ccf0d7b87f48fb415022051d6150.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_b2df60a13d5790f1cac6bd219b642cb4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_b2df60a13d5790f1cac6bd219b642cb4.jpg not downloaded yet
2026-03-28 11:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 498fe583-9687-5692-9bb0-ea4a8b82d27b with identifier: JZ80953
2026-03-28 11:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498fe583-9687-5692-9bb0-ea4a8b82d27b with scrape type 1
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 498fe583-9687-5692-9bb0-ea4a8b82d27b
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_4ed122fc5d0d18141a6e59c8147715a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_4ed122fc5d0d18141a6e59c8147715a1.jpg not downloaded yet
2026-03-28 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_aa9579863e6d675a1eacfc7def04514e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_7240ae62271b9bb74d1637470d86c23c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_af2720342e268bb8f7334618c9cac541.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_af2720342e268bb8f7334618c9cac541.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_5d24c115dddc165c0de4f138612a4f20.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_5d24c115dddc165c0de4f138612a4f20.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_2b001672979ab28e61ca52a61e8ba8ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_2b001672979ab28e61ca52a61e8ba8ec.jpg not downloaded yet
2026-03-28 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_9f4b3abee180cd75fb14607b607203a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_e57eb8d5d7685067e34c73722e4a70a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_e57eb8d5d7685067e34c73722e4a70a9.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_323ba4a21948663a5f7612fca0b8be42.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_323ba4a21948663a5f7612fca0b8be42.jpg not downloaded yet
2026-03-28 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_83cac5a8574834062eefbe2a884ba22a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_985f7c70a3579a055e2d59bcbcff1f0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_985f7c70a3579a055e2d59bcbcff1f0d.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_96a8c9e7db5d1199285673195bad1248.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_96a8c9e7db5d1199285673195bad1248.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_7338d63b9d24e05019d10abbf208775d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_7338d63b9d24e05019d10abbf208775d.jpg not downloaded yet
2026-03-28 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY19882> (referer: https://www.auto1.com/v1/car-details-view/JY19882/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41dbe90>
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_1cec35cc0351ce0f8042c1424d494d75.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_1cec35cc0351ce0f8042c1424d494d75.jpg saved to cache
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b72da8e-378d-5b38-bbba-a33071818563
2026-03-28 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_a4e3fb405658514685d3321880c68802.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_1c614bbe293ca46eb070e3f286bd8e6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_1c614bbe293ca46eb070e3f286bd8e6e.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_e719fc9e69278b059fe303c20818b2e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_e719fc9e69278b059fe303c20818b2e0.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_f1e8c32c07f12281d1af3366bea1a560.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_f1e8c32c07f12281d1af3366bea1a560.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_78aef8328e5b4d5e69c65a7284c7dd63.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_78aef8328e5b4d5e69c65a7284c7dd63.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_1501785d6842f43f8f6df74319b48c84.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_1501785d6842f43f8f6df74319b48c84.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_24019e252defe81bddf0351577038ede.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_24019e252defe81bddf0351577038ede.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_a3a115603632e7779e17e4adeab1a4d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_a3a115603632e7779e17e4adeab1a4d8.jpg not downloaded yet
2026-03-28 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_c43685ffc8a4972f8da97210800d3fe4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_c43685ffc8a4972f8da97210800d3fe4.jpg not downloaded yet
2026-03-28 11:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_2edf8db05c60f934a544f4e5142a0631.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_3974de0ccac0a6de9fc613eaaa2021f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_3974de0ccac0a6de9fc613eaaa2021f7.jpg not downloaded yet
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_8a168694b847872fd8a6f919b7d1f67f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_8a168694b847872fd8a6f919b7d1f67f.jpg not downloaded yet
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa443d650>
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_aa9579863e6d675a1eacfc7def04514e.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_aa9579863e6d675a1eacfc7def04514e.jpg saved to cache
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 708665a9-0358-5916-ac8f-c4940f6c0658
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa418e250>
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_7240ae62271b9bb74d1637470d86c23c.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_7240ae62271b9bb74d1637470d86c23c.jpg saved to cache
2026-03-28 11:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b42d776-915d-5179-afd8-c2d3d89179cf
2026-03-28 11:30:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa44733d0>
2026-03-28 11:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_9f4b3abee180cd75fb14607b607203a0.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_9f4b3abee180cd75fb14607b607203a0.jpg saved to cache
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b72da8e-378d-5b38-bbba-a33071818563
2026-03-28 11:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa441d810>
2026-03-28 11:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_83cac5a8574834062eefbe2a884ba22a.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_83cac5a8574834062eefbe2a884ba22a.jpg saved to cache
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d927ef0d-1f06-57f7-8d01-f304e031bd35
2026-03-28 11:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7159a46c-2b19-5f82-b1c8-43101d26062f with identifier: JY19882
2026-03-28 11:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7159a46c-2b19-5f82-b1c8-43101d26062f with scrape type 1
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7159a46c-2b19-5f82-b1c8-43101d26062f
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F5f%252Ff65fd92f838b7cf2c0c55f527466c684%252Fpa%252FJY19882_be66ee123818ca1eb545f87a89a90146.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_be66ee123818ca1eb545f87a89a90146.jpg not downloaded yet
2026-03-28 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_f7cabe53b3f2e692729fd39e404752a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_cf2d9959a11607f3223269e690ffe8a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_7cd3bd57acde734985008fe54879091d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_7cd3bd57acde734985008fe54879091d.jpg not downloaded yet
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_ca97475f82bc53dcf8932d0ea5cee81b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_ca97475f82bc53dcf8932d0ea5cee81b.jpg not downloaded yet
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F5f%252Ff65fd92f838b7cf2c0c55f527466c684%252Fpa%252FJY19882_7df18d657357f2a0dafb51ea020349e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_7df18d657357f2a0dafb51ea020349e8.jpg not downloaded yet
2026-03-28 11:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e4e790>
2026-03-28 11:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_a4e3fb405658514685d3321880c68802.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_a4e3fb405658514685d3321880c68802.jpg saved to cache
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 708665a9-0358-5916-ac8f-c4940f6c0658
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_df7ebd62aebf2ae6843a4e76b7d3fece.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_df7ebd62aebf2ae6843a4e76b7d3fece.jpg not downloaded yet
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_471fb7186aed4154437b168adf69602c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_471fb7186aed4154437b168adf69602c.jpg not downloaded yet
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F5f%252Ff65fd92f838b7cf2c0c55f527466c684%252Fpa%252FJY19882_5099835a73da4b584217c504943b698f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_5099835a73da4b584217c504943b698f.jpg not downloaded yet
2026-03-28 11:30:49 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1816 | hits on page: 40
2026-03-28 11:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa441c590>
2026-03-28 11:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_2edf8db05c60f934a544f4e5142a0631.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_2edf8db05c60f934a544f4e5142a0631.jpg saved to cache
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a
2026-03-28 11:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_9447ccf0d7b87f48fb415022051d6150.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_b1ead19144a5846c6a3b6f4f5ee1f277.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_b1ead19144a5846c6a3b6f4f5ee1f277.jpg not downloaded yet
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_5ed05efc24f3e0c431fbd6bf27a63a32.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_5ed05efc24f3e0c431fbd6bf27a63a32.jpg not downloaded yet
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F5f%252Ff65fd92f838b7cf2c0c55f527466c684%252Fpa%252FJY19882_fff79ce41846f5cbaf7f32f2d39e9223.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_fff79ce41846f5cbaf7f32f2d39e9223.jpg not downloaded yet
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [auto1.be] INFO: Scrape type for SB67636: 0
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: NA16602
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA16602%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [auto1.be] INFO: Scrape type for NA16602: 0
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: GM68139
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [auto1.be] INFO: Scrape type for YC48670: 0
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [auto1.be] INFO: Scrape type for XB95573: 0
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [auto1.be] INFO: Scrape type for ZB59407: 0
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: CW56450
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: UA44926
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: XU56519
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU56519%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [auto1.be] INFO: Scrape type for XU56519: 0
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: EP21632
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP21632%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [auto1.be] INFO: Scrape type for EP21632: 0
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: JE64072
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE64072%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [auto1.be] INFO: Scrape type for JE64072: 0
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: AW18524
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW18524%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [auto1.be] INFO: Scrape type for AW18524: 0
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: PD31186
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD31186%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [auto1.be] INFO: Scrape type for PD31186: 0
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: NS20906
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS20906%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [auto1.be] INFO: Scrape type for NS20906: 0
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: PJ37303
2026-03-28 11:30:49 [auto1.be] INFO: Found listing with ID: VS66255
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS66255%27 HTTP/1.1" 200 None
2026-03-28 11:30:49 [auto1.be] INFO: Scrape type for VS66255: 2
2026-03-28 11:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 863b6aa8-bdfc-5fbe-b563-4fa53e3b1fc4 with identifier: VS66255
2026-03-28 11:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 863b6aa8-bdfc-5fbe-b563-4fa53e3b1fc4 with scrape type 2
2026-03-28 11:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 863b6aa8-bdfc-5fbe-b563-4fa53e3b1fc4 with scrape type 2
2026-03-28 11:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 863b6aa8-bdfc-5fbe-b563-4fa53e3b1fc4, identifier: VS66255
2026-03-28 11:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 863b6aa8-bdfc-5fbe-b563-4fa53e3b1fc4 with identifier: VS66255
2026-03-28 11:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 863b6aa8-bdfc-5fbe-b563-4fa53e3b1fc4 with identifier: VS66255
2026-03-28 11:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 863b6aa8-bdfc-5fbe-b563-4fa53e3b1fc4 with identifier: VS66255 to the API
2026-03-28 11:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:03:49Z',
 'fuel_type': 'diesel',
 'id': '863b6aa8-bdfc-5fbe-b563-4fa53e3b1fc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS66255',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'X-Klasse',
 'odometer': 185052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-14',
 'seller_name': None,
 'title': 'Mercedes-Benz X-Klasse X 350 d 4Matic Doppelkabine Power',
 'transmission': 'automatic',
 'trim': '4Matic Doppelkabine Power',
 'year': 2019}
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS66255%27 HTTP/1.1" 200 None
2026-03-28 11:30:50 [auto1.be] INFO: Saving data for VS66255: {'auction_closing_time': 1774713829.0, 'created_time': 1773953003.857979, 'last_price_update_time': 1774697450.204879}
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VS66255') HTTP/1.1" 204 0
2026-03-28 11:30:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa448ae10>
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_f7cabe53b3f2e692729fd39e404752a7.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_f7cabe53b3f2e692729fd39e404752a7.jpg saved to cache
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4cdbe90>
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_cf2d9959a11607f3223269e690ffe8a8.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_cf2d9959a11607f3223269e690ffe8a8.jpg saved to cache
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d927ef0d-1f06-57f7-8d01-f304e031bd35
2026-03-28 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_2b001672979ab28e61ca52a61e8ba8ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_aa51c105fe542fcd342af8b0e60338c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_aa51c105fe542fcd342af8b0e60338c2.jpg not downloaded yet
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F5f%252Ff65fd92f838b7cf2c0c55f527466c684%252Fpa%252FJY19882_68096c75fdc7dd209ec6ffcc6bcc9b25.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_68096c75fdc7dd209ec6ffcc6bcc9b25.jpg not downloaded yet
2026-03-28 11:30:50 [auto1.be] INFO: Found listing with ID: FZ96232
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ96232%27 HTTP/1.1" 200 None
2026-03-28 11:30:50 [auto1.be] INFO: Scrape type for FZ96232: 0
2026-03-28 11:30:50 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-28 11:30:50 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-28 11:30:50 [auto1.be] INFO: Scrape type for RL24593: 0
2026-03-28 11:30:50 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-28 11:30:50 [auto1.be] INFO: Found listing with ID: ZJ09914
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ09914%27 HTTP/1.1" 200 None
2026-03-28 11:30:50 [auto1.be] INFO: Scrape type for ZJ09914: 0
2026-03-28 11:30:50 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ61714%27 HTTP/1.1" 200 None
2026-03-28 11:30:50 [auto1.be] INFO: Scrape type for HJ61714: 0
2026-03-28 11:30:50 [auto1.be] INFO: Found listing with ID: ZL48181
2026-03-28 11:30:50 [auto1.be] INFO: Found listing with ID: WS64524
2026-03-28 11:30:50 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-28 11:30:50 [auto1.be] INFO: Scrape type for UR44884: 0
2026-03-28 11:30:50 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-28 11:30:50 [auto1.be] INFO: Found listing with ID: DX33442
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX33442%27 HTTP/1.1" 200 None
2026-03-28 11:30:50 [auto1.be] INFO: Scrape type for DX33442: 0
2026-03-28 11:30:50 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-28 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_a731adc292ba09b2308d91769c3dec5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_d9af9e0e860cb4c4f556ffd202472596.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_d9af9e0e860cb4c4f556ffd202472596.jpg not downloaded yet
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F5f%252Ff65fd92f838b7cf2c0c55f527466c684%252Fpa%252FJY19882_79b1af89bdff91e643c9598bb79fa5e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_79b1af89bdff91e643c9598bb79fa5e5.jpg not downloaded yet
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4282150>
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_9447ccf0d7b87f48fb415022051d6150.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_9447ccf0d7b87f48fb415022051d6150.jpg saved to cache
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 708665a9-0358-5916-ac8f-c4940f6c0658
2026-03-28 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_5d24c115dddc165c0de4f138612a4f20.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4ea8950>
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_2b001672979ab28e61ca52a61e8ba8ec.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_2b001672979ab28e61ca52a61e8ba8ec.jpg saved to cache
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 708665a9-0358-5916-ac8f-c4940f6c0658
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa44abbd0>
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_a731adc292ba09b2308d91769c3dec5b.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_a731adc292ba09b2308d91769c3dec5b.jpg saved to cache
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b42d776-915d-5179-afd8-c2d3d89179cf
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa44560d0>
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_5d24c115dddc165c0de4f138612a4f20.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_5d24c115dddc165c0de4f138612a4f20.jpg saved to cache
2026-03-28 11:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b42d776-915d-5179-afd8-c2d3d89179cf
2026-03-28 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_7338d63b9d24e05019d10abbf208775d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_37934075ca58bfdff7af8cd74709a295.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_69c71fbca070b1e9b4878c2266d3f2b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_271a285a7375008f9497ac668e4a8eaf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_d31f0722224d8588fc21578fb158d280.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_f92e74a952a959cdf6516cd5c79cd681.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_fff79ce41846f5cbaf7f32f2d39e9223.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_be66ee123818ca1eb545f87a89a90146.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_68096c75fdc7dd209ec6ffcc6bcc9b25.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_a3a115603632e7779e17e4adeab1a4d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_79b1af89bdff91e643c9598bb79fa5e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_96a8c9e7db5d1199285673195bad1248.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4367d90>
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_7338d63b9d24e05019d10abbf208775d.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_7338d63b9d24e05019d10abbf208775d.jpg saved to cache
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 708665a9-0358-5916-ac8f-c4940f6c0658
2026-03-28 11:30:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41a3f10>
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_37934075ca58bfdff7af8cd74709a295.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_37934075ca58bfdff7af8cd74709a295.jpg saved to cache
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a
2026-03-28 11:30:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4cd27d0>
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_69c71fbca070b1e9b4878c2266d3f2b9.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_69c71fbca070b1e9b4878c2266d3f2b9.jpg saved to cache
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a
2026-03-28 11:30:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa420c210>
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_271a285a7375008f9497ac668e4a8eaf.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_271a285a7375008f9497ac668e4a8eaf.jpg saved to cache
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a
2026-03-28 11:30:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa436a550>
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_d31f0722224d8588fc21578fb158d280.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_d31f0722224d8588fc21578fb158d280.jpg saved to cache
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c308775-4db8-55d1-af91-dc9daebcc7bf
2026-03-28 11:30:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa420e450>
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_f92e74a952a959cdf6516cd5c79cd681.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_f92e74a952a959cdf6516cd5c79cd681.jpg saved to cache
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b42d776-915d-5179-afd8-c2d3d89179cf
2026-03-28 11:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_24019e252defe81bddf0351577038ede.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e68590>
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7159a46c-2b19-5f82-b1c8-43101d26062f/7159a46c-2b19-5f82-b1c8-43101d26062f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F5f%252Ff65fd92f838b7cf2c0c55f527466c684%252Fpa%252FJY19882_fff79ce41846f5cbaf7f32f2d39e9223.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_fff79ce41846f5cbaf7f32f2d39e9223.jpg saved to cache
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7159a46c-2b19-5f82-b1c8-43101d26062f
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa433ed10>
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7159a46c-2b19-5f82-b1c8-43101d26062f/7159a46c-2b19-5f82-b1c8-43101d26062f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F5f%252Ff65fd92f838b7cf2c0c55f527466c684%252Fpa%252FJY19882_be66ee123818ca1eb545f87a89a90146.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_be66ee123818ca1eb545f87a89a90146.jpg saved to cache
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7159a46c-2b19-5f82-b1c8-43101d26062f
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa424d9d0>
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7159a46c-2b19-5f82-b1c8-43101d26062f/7159a46c-2b19-5f82-b1c8-43101d26062f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F5f%252Ff65fd92f838b7cf2c0c55f527466c684%252Fpa%252FJY19882_68096c75fdc7dd209ec6ffcc6bcc9b25.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_68096c75fdc7dd209ec6ffcc6bcc9b25.jpg saved to cache
2026-03-28 11:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7159a46c-2b19-5f82-b1c8-43101d26062f
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa43e1310>
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_a3a115603632e7779e17e4adeab1a4d8.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_a3a115603632e7779e17e4adeab1a4d8.jpg saved to cache
2026-03-28 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 498fe583-9687-5692-9bb0-ea4a8b82d27b
2026-03-28 11:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa70f0bd0>
2026-03-28 11:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7159a46c-2b19-5f82-b1c8-43101d26062f/7159a46c-2b19-5f82-b1c8-43101d26062f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F5f%252Ff65fd92f838b7cf2c0c55f527466c684%252Fpa%252FJY19882_79b1af89bdff91e643c9598bb79fa5e5.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_79b1af89bdff91e643c9598bb79fa5e5.jpg saved to cache
2026-03-28 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7159a46c-2b19-5f82-b1c8-43101d26062f
2026-03-28 11:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4473b10>
2026-03-28 11:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_96a8c9e7db5d1199285673195bad1248.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_96a8c9e7db5d1199285673195bad1248.jpg saved to cache
2026-03-28 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b42d776-915d-5179-afd8-c2d3d89179cf
2026-03-28 11:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa411b950>
2026-03-28 11:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_24019e252defe81bddf0351577038ede.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_24019e252defe81bddf0351577038ede.jpg saved to cache
2026-03-28 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff
2026-03-28 11:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_8a168694b847872fd8a6f919b7d1f67f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_aa51c105fe542fcd342af8b0e60338c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_5099835a73da4b584217c504943b698f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:52 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1816 | hits on page: 40
2026-03-28 11:30:52 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-28 11:30:52 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-28 11:30:52 [auto1.be] INFO: Found listing with ID: CC60514
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC60514%27 HTTP/1.1" 200 None
2026-03-28 11:30:52 [auto1.be] INFO: Scrape type for CC60514: 0
2026-03-28 11:30:52 [auto1.be] INFO: Found listing with ID: BP07679
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP07679%27 HTTP/1.1" 200 None
2026-03-28 11:30:52 [auto1.be] INFO: Scrape type for BP07679: 0
2026-03-28 11:30:52 [auto1.be] INFO: Found listing with ID: BJ84732
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ84732%27 HTTP/1.1" 200 None
2026-03-28 11:30:52 [auto1.be] INFO: Scrape type for BJ84732: 2
2026-03-28 11:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abc7fd79-5e19-5fb5-b88b-51b59a75c102 with identifier: BJ84732
2026-03-28 11:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abc7fd79-5e19-5fb5-b88b-51b59a75c102 with scrape type 2
2026-03-28 11:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abc7fd79-5e19-5fb5-b88b-51b59a75c102 with scrape type 2
2026-03-28 11:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: abc7fd79-5e19-5fb5-b88b-51b59a75c102, identifier: BJ84732
2026-03-28 11:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: abc7fd79-5e19-5fb5-b88b-51b59a75c102 with identifier: BJ84732
2026-03-28 11:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: abc7fd79-5e19-5fb5-b88b-51b59a75c102 with identifier: BJ84732
2026-03-28 11:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: abc7fd79-5e19-5fb5-b88b-51b59a75c102 with identifier: BJ84732 to the API
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:26:19Z',
 'fuel_type': 'diesel',
 'id': 'abc7fd79-5e19-5fb5-b88b-51b59a75c102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ84732',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 198406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-28',
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 1.6 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2013}
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ84732%27 HTTP/1.1" 200 None
2026-03-28 11:30:53 [auto1.be] INFO: Saving data for BJ84732: {'auction_closing_time': 1774715179.0, 'created_time': 1774513851.388167, 'last_price_update_time': 1774697453.078125}
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ84732') HTTP/1.1" 204 0
2026-03-28 11:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_7df18d657357f2a0dafb51ea020349e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: ZY53321
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-28 11:30:53 [auto1.be] INFO: Scrape type for TH79553: 0
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: AN14983
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: KY60433
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: HF70171
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF70171%27 HTTP/1.1" 200 None
2026-03-28 11:30:53 [auto1.be] INFO: Scrape type for HF70171: 0
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: YV88346
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: CS11712
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS11712%27 HTTP/1.1" 200 None
2026-03-28 11:30:53 [auto1.be] INFO: Scrape type for CS11712: 0
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-28 11:30:53 [auto1.be] INFO: Scrape type for WA78577: 0
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: NY90859
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY90859%27 HTTP/1.1" 200 None
2026-03-28 11:30:53 [auto1.be] INFO: Scrape type for NY90859: 0
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: SX76756
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU54459%27 HTTP/1.1" 200 None
2026-03-28 11:30:53 [auto1.be] INFO: Scrape type for YU54459: 0
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-28 11:30:53 [auto1.be] INFO: Scrape type for ZJ26609: 0
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: UN79459
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: RD83049
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: UE64261
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: UA02413
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-28 11:30:53 [auto1.be] INFO: Scrape type for YW15851: 0
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: FW97507
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW97507%27 HTTP/1.1" 200 None
2026-03-28 11:30:53 [auto1.be] INFO: Scrape type for FW97507: 0
2026-03-28 11:30:53 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-28 11:30:53 [auto1.be] INFO: Scrape type for VM06685: 2
2026-03-28 11:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8 with identifier: VM06685
2026-03-28 11:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8 with scrape type 2
2026-03-28 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8 with scrape type 2
2026-03-28 11:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8, identifier: VM06685
2026-03-28 11:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_df7ebd62aebf2ae6843a4e76b7d3fece.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_471fb7186aed4154437b168adf69602c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_b1ead19144a5846c6a3b6f4f5ee1f277.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8 with identifier: VM06685
2026-03-28 11:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8 with identifier: VM06685
2026-03-28 11:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8 with identifier: VM06685 to the API
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:15:36Z',
 'fuel_type': 'diesel',
 'id': '9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM06685',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 173989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-20',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2015}
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-28 11:30:53 [auto1.be] INFO: Saving data for VM06685: {'auction_closing_time': 1774714536.0, 'created_time': 1774513862.712195, 'last_price_update_time': 1774697453.781863}
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM06685') HTTP/1.1" 204 0
2026-03-28 11:30:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa43eb090>
2026-03-28 11:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_8a168694b847872fd8a6f919b7d1f67f.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_8a168694b847872fd8a6f919b7d1f67f.jpg saved to cache
2026-03-28 11:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 498fe583-9687-5692-9bb0-ea4a8b82d27b
2026-03-28 11:30:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa5afc810>
2026-03-28 11:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_aa51c105fe542fcd342af8b0e60338c2.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_aa51c105fe542fcd342af8b0e60338c2.jpg saved to cache
2026-03-28 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 498fe583-9687-5692-9bb0-ea4a8b82d27b
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa443df90>
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7159a46c-2b19-5f82-b1c8-43101d26062f/7159a46c-2b19-5f82-b1c8-43101d26062f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F5f%252Ff65fd92f838b7cf2c0c55f527466c684%252Fpa%252FJY19882_5099835a73da4b584217c504943b698f.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_5099835a73da4b584217c504943b698f.jpg saved to cache
2026-03-28 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7159a46c-2b19-5f82-b1c8-43101d26062f
2026-03-28 11:30:54 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV48703%27 HTTP/1.1" 200 None
2026-03-28 11:30:54 [auto1.be] INFO: Scrape type for BV48703: 0
2026-03-28 11:30:54 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-28 11:30:54 [auto1.be] INFO: Scrape type for AP73624: 0
2026-03-28 11:30:54 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-28 11:30:54 [auto1.be] INFO: Found listing with ID: GR59169
2026-03-28 11:30:54 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-28 11:30:54 [auto1.be] INFO: Found listing with ID: EU62289
2026-03-28 11:30:54 [auto1.be] INFO: Found listing with ID: CD49424
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD49424%27 HTTP/1.1" 200 None
2026-03-28 11:30:54 [auto1.be] INFO: Scrape type for CD49424: 0
2026-03-28 11:30:54 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-28 11:30:54 [auto1.be] INFO: Scrape type for TK06008: 0
2026-03-28 11:30:54 [auto1.be] INFO: Found listing with ID: CB83529
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB83529%27 HTTP/1.1" 200 None
2026-03-28 11:30:54 [auto1.be] INFO: Scrape type for CB83529: 0
2026-03-28 11:30:54 [auto1.be] INFO: Found listing with ID: UY34389
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY34389%27 HTTP/1.1" 200 None
2026-03-28 11:30:54 [auto1.be] INFO: Scrape type for UY34389: 0
2026-03-28 11:30:54 [auto1.be] INFO: Found listing with ID: HE19111
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE19111%27 HTTP/1.1" 200 None
2026-03-28 11:30:54 [auto1.be] INFO: Scrape type for HE19111: 0
2026-03-28 11:30:54 [auto1.be] INFO: Found listing with ID: YF40273
2026-03-28 11:30:54 [auto1.be] INFO: Found listing with ID: RW00406
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW00406%27 HTTP/1.1" 200 None
2026-03-28 11:30:54 [auto1.be] INFO: Scrape type for RW00406: 0
2026-03-28 11:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL44110/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d3a650>
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7159a46c-2b19-5f82-b1c8-43101d26062f/7159a46c-2b19-5f82-b1c8-43101d26062f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F5f%252Ff65fd92f838b7cf2c0c55f527466c684%252Fpa%252FJY19882_7df18d657357f2a0dafb51ea020349e8.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_7df18d657357f2a0dafb51ea020349e8.jpg saved to cache
2026-03-28 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7159a46c-2b19-5f82-b1c8-43101d26062f
2026-03-28 11:30:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7159a46c-2b19-5f82-b1c8-43101d26062f, skipping ID generation
2026-03-28 11:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7159a46c-2b19-5f82-b1c8-43101d26062f with scrape type 1
2026-03-28 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7159a46c-2b19-5f82-b1c8-43101d26062f sending to next pipeline
2026-03-28 11:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7159a46c-2b19-5f82-b1c8-43101d26062f, identifier: JY19882
2026-03-28 11:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7159a46c-2b19-5f82-b1c8-43101d26062f with identifier: JY19882
2026-03-28 11:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7159a46c-2b19-5f82-b1c8-43101d26062f with identifier: JY19882
2026-03-28 11:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7159a46c-2b19-5f82-b1c8-43101d26062f with identifier: JY19882 to the API
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_7df18d657357f2a0dafb51ea020349e8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:08:15Z',
 'fuel_type': 'diesel',
 'id': '7159a46c-2b19-5f82-b1c8-43101d26062f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY19882',
 'listing': 'auction',
 'location': 'BE, Lommel',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 200111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7159a46c-2b19-5f82-b1c8-43101d26062f/7159a46c-2b19-5f82-b1c8-43101d26062f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_be66ee123818ca1eb545f87a89a90146.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7159a46c-2b19-5f82-b1c8-43101d26062f/7159a46c-2b19-5f82-b1c8-43101d26062f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_7df18d657357f2a0dafb51ea020349e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7159a46c-2b19-5f82-b1c8-43101d26062f/7159a46c-2b19-5f82-b1c8-43101d26062f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_5099835a73da4b584217c504943b698f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7159a46c-2b19-5f82-b1c8-43101d26062f/7159a46c-2b19-5f82-b1c8-43101d26062f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_fff79ce41846f5cbaf7f32f2d39e9223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7159a46c-2b19-5f82-b1c8-43101d26062f/7159a46c-2b19-5f82-b1c8-43101d26062f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_68096c75fdc7dd209ec6ffcc6bcc9b25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7159a46c-2b19-5f82-b1c8-43101d26062f/7159a46c-2b19-5f82-b1c8-43101d26062f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/5f/f65fd92f838b7cf2c0c55f527466c684/pa/JY19882_79b1af89bdff91e643c9598bb79fa5e5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY19882%27 HTTP/1.1" 200 None
2026-03-28 11:30:54 [auto1.be] INFO: Saving data for JY19882: {'created_time': 1774697454.767282, 'last_price_update_time': 1774697454.767297, 'auction_closing_time': 1774883295.0}
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JY19882') HTTP/1.1" 204 0
2026-03-28 11:30:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_1501785d6842f43f8f6df74319b48c84.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_c43685ffc8a4972f8da97210800d3fe4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_78aef8328e5b4d5e69c65a7284c7dd63.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e7e850>
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_df7ebd62aebf2ae6843a4e76b7d3fece.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_df7ebd62aebf2ae6843a4e76b7d3fece.jpg saved to cache
2026-03-28 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d3b750>
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_471fb7186aed4154437b168adf69602c.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_471fb7186aed4154437b168adf69602c.jpg saved to cache
2026-03-28 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 498fe583-9687-5692-9bb0-ea4a8b82d27b
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4411b90>
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_b1ead19144a5846c6a3b6f4f5ee1f277.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_b1ead19144a5846c6a3b6f4f5ee1f277.jpg saved to cache
2026-03-28 11:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa441f9d0>
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_1501785d6842f43f8f6df74319b48c84.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_1501785d6842f43f8f6df74319b48c84.jpg saved to cache
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 708665a9-0358-5916-ac8f-c4940f6c0658
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41db350>
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_c43685ffc8a4972f8da97210800d3fe4.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_c43685ffc8a4972f8da97210800d3fe4.jpg saved to cache
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 708665a9-0358-5916-ac8f-c4940f6c0658
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa437a0d0>
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_78aef8328e5b4d5e69c65a7284c7dd63.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_78aef8328e5b4d5e69c65a7284c7dd63.jpg saved to cache
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b42d776-915d-5179-afd8-c2d3d89179cf
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_5ed05efc24f3e0c431fbd6bf27a63a32.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_d9af9e0e860cb4c4f556ffd202472596.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_7cd3bd57acde734985008fe54879091d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_ca97475f82bc53dcf8932d0ea5cee81b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_3974de0ccac0a6de9fc613eaaa2021f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_e719fc9e69278b059fe303c20818b2e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_f1e8c32c07f12281d1af3366bea1a560.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_1c614bbe293ca46eb070e3f286bd8e6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41e1790>
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_5ed05efc24f3e0c431fbd6bf27a63a32.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_5ed05efc24f3e0c431fbd6bf27a63a32.jpg saved to cache
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 498fe583-9687-5692-9bb0-ea4a8b82d27b
2026-03-28 11:30:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e300d0>
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_d9af9e0e860cb4c4f556ffd202472596.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_d9af9e0e860cb4c4f556ffd202472596.jpg saved to cache
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 498fe583-9687-5692-9bb0-ea4a8b82d27b
2026-03-28 11:30:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4492650>
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_7cd3bd57acde734985008fe54879091d.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_7cd3bd57acde734985008fe54879091d.jpg saved to cache
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff
2026-03-28 11:30:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4cfc690>
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_ca97475f82bc53dcf8932d0ea5cee81b.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_ca97475f82bc53dcf8932d0ea5cee81b.jpg saved to cache
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 498fe583-9687-5692-9bb0-ea4a8b82d27b
2026-03-28 11:30:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41109d0>
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_3974de0ccac0a6de9fc613eaaa2021f7.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_3974de0ccac0a6de9fc613eaaa2021f7.jpg saved to cache
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa6c05b50>
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_e719fc9e69278b059fe303c20818b2e0.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_e719fc9e69278b059fe303c20818b2e0.jpg saved to cache
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 498fe583-9687-5692-9bb0-ea4a8b82d27b
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d88ad0>
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_f1e8c32c07f12281d1af3366bea1a560.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_f1e8c32c07f12281d1af3366bea1a560.jpg saved to cache
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d927ef0d-1f06-57f7-8d01-f304e031bd35
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa446c910>
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_1c614bbe293ca46eb070e3f286bd8e6e.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_1c614bbe293ca46eb070e3f286bd8e6e.jpg saved to cache
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_157a90bf6d894c2998b9f804089fe2d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_b2df60a13d5790f1cac6bd219b642cb4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_985f7c70a3579a055e2d59bcbcff1f0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_323ba4a21948663a5f7612fca0b8be42.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_af2720342e268bb8f7334618c9cac541.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_4ed122fc5d0d18141a6e59c8147715a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_e57eb8d5d7685067e34c73722e4a70a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4335090>
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_157a90bf6d894c2998b9f804089fe2d6.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_157a90bf6d894c2998b9f804089fe2d6.jpg saved to cache
2026-03-28 11:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d927ef0d-1f06-57f7-8d01-f304e031bd35
2026-03-28 11:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4ccc790>
2026-03-28 11:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_b2df60a13d5790f1cac6bd219b642cb4.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_b2df60a13d5790f1cac6bd219b642cb4.jpg saved to cache
2026-03-28 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff
2026-03-28 11:30:56 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1816 | hits on page: 40
2026-03-28 11:30:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41bf850>
2026-03-28 11:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_985f7c70a3579a055e2d59bcbcff1f0d.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_985f7c70a3579a055e2d59bcbcff1f0d.jpg saved to cache
2026-03-28 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d927ef0d-1f06-57f7-8d01-f304e031bd35
2026-03-28 11:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_5785011febbd8e395d8fbb9cb951e93e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: UA36115
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36115%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for UA36115: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for XH41981: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: UT11356
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT11356%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for UT11356: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for LK16000: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: HB25779
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB25779%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for HB25779: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: CW76300
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW76300%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for CW76300: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: KH30418
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: KX63098
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: CK71488
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: BF87746
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF87746%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for BF87746: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for RR89556: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN34238%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for JN34238: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: NP31982
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP31982%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for NP31982: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY23736%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for ZY23736: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: MR44504
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: BU20603
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: DJ10477
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ10477%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for DJ10477: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for WK92284: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for YD21406: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: VF99667
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: CC33949
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC33949%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for CC33949: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: ZZ76068
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ76068%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for ZZ76068: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: TY40613
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY40613%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for TY40613: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for DM43787: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: FC96000
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC96000%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for FC96000: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for DW61635: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for DH81993: 0
2026-03-28 11:30:56 [auto1.be] INFO: Found listing with ID: RL73626
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL73626%27 HTTP/1.1" 200 None
2026-03-28 11:30:56 [auto1.be] INFO: Scrape type for RL73626: 2
2026-03-28 11:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54cd90f6-78d8-5011-9282-6da9dcf4253d with identifier: RL73626
2026-03-28 11:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54cd90f6-78d8-5011-9282-6da9dcf4253d with scrape type 2
2026-03-28 11:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54cd90f6-78d8-5011-9282-6da9dcf4253d with scrape type 2
2026-03-28 11:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 54cd90f6-78d8-5011-9282-6da9dcf4253d, identifier: RL73626
2026-03-28 11:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_7a2c78a4b3819ef412d90cdf2e464bfd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_694ce225d40eb9819ed47a727a95793a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 54cd90f6-78d8-5011-9282-6da9dcf4253d with identifier: RL73626
2026-03-28 11:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 54cd90f6-78d8-5011-9282-6da9dcf4253d with identifier: RL73626
2026-03-28 11:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 54cd90f6-78d8-5011-9282-6da9dcf4253d with identifier: RL73626 to the API
2026-03-28 11:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:12:05Z',
 'fuel_type': 'petrol',
 'id': '54cd90f6-78d8-5011-9282-6da9dcf4253d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL73626',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 81561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-05',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL73626%27 HTTP/1.1" 200 None
2026-03-28 11:30:57 [auto1.be] INFO: Saving data for RL73626: {'auction_closing_time': 1774714325.0, 'created_time': 1773238115.052405, 'last_price_update_time': 1774697457.432035}
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL73626') HTTP/1.1" 204 0
2026-03-28 11:30:57 [auto1.be] INFO: Found listing with ID: XF90058
2026-03-28 11:30:57 [auto1.be] INFO: Found listing with ID: WG55963
2026-03-28 11:30:57 [auto1.be] INFO: Found listing with ID: RY67713
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY67713%27 HTTP/1.1" 200 None
2026-03-28 11:30:57 [auto1.be] INFO: Scrape type for RY67713: 0
2026-03-28 11:30:57 [auto1.be] INFO: Found listing with ID: LK47918
2026-03-28 11:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL44110> (referer: https://www.auto1.com/v1/car-details-view/TL44110/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa415d1d0>
2026-03-28 11:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_323ba4a21948663a5f7612fca0b8be42.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_323ba4a21948663a5f7612fca0b8be42.jpg saved to cache
2026-03-28 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 498fe583-9687-5692-9bb0-ea4a8b82d27b
2026-03-28 11:30:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4491350>
2026-03-28 11:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_af2720342e268bb8f7334618c9cac541.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_af2720342e268bb8f7334618c9cac541.jpg saved to cache
2026-03-28 11:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d927ef0d-1f06-57f7-8d01-f304e031bd35
2026-03-28 11:30:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4425510>
2026-03-28 11:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6c%252F756c440cd6249d8b1000afd2430c78d9%252Fpa%252FJZ80953_4ed122fc5d0d18141a6e59c8147715a1.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_4ed122fc5d0d18141a6e59c8147715a1.jpg saved to cache
2026-03-28 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 498fe583-9687-5692-9bb0-ea4a8b82d27b
2026-03-28 11:30:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 498fe583-9687-5692-9bb0-ea4a8b82d27b, skipping ID generation
2026-03-28 11:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498fe583-9687-5692-9bb0-ea4a8b82d27b with scrape type 1
2026-03-28 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 498fe583-9687-5692-9bb0-ea4a8b82d27b sending to next pipeline
2026-03-28 11:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 498fe583-9687-5692-9bb0-ea4a8b82d27b, identifier: JZ80953
2026-03-28 11:30:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4cff850>
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_e57eb8d5d7685067e34c73722e4a70a9.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_e57eb8d5d7685067e34c73722e4a70a9.jpg saved to cache
2026-03-28 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa424c990>
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_5785011febbd8e395d8fbb9cb951e93e.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_5785011febbd8e395d8fbb9cb951e93e.jpg saved to cache
2026-03-28 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 708665a9-0358-5916-ac8f-c4940f6c0658
2026-03-28 11:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_e9c4bb65bcf913dc89e0cb661ca664aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 498fe583-9687-5692-9bb0-ea4a8b82d27b with identifier: JZ80953
2026-03-28 11:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 498fe583-9687-5692-9bb0-ea4a8b82d27b with identifier: JZ80953
2026-03-28 11:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 498fe583-9687-5692-9bb0-ea4a8b82d27b with identifier: JZ80953 to the API
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_4ed122fc5d0d18141a6e59c8147715a1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:16:04Z',
 'fuel_type': 'hybrid',
 'id': '498fe583-9687-5692-9bb0-ea4a8b82d27b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ80953',
 'listing': 'auction',
 'location': 'BE, Waver',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 62410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2739346,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_4ed122fc5d0d18141a6e59c8147715a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2611075,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_323ba4a21948663a5f7612fca0b8be42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_e719fc9e69278b059fe303c20818b2e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_a3a115603632e7779e17e4adeab1a4d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2729273,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_8a168694b847872fd8a6f919b7d1f67f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2906271,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_ca97475f82bc53dcf8932d0ea5cee81b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_471fb7186aed4154437b168adf69602c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542321,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_5ed05efc24f3e0c431fbd6bf27a63a32.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2496819,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_aa51c105fe542fcd342af8b0e60338c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498fe583-9687-5692-9bb0-ea4a8b82d27b/498fe583-9687-5692-9bb0-ea4a8b82d27b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3383647,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6c/756c440cd6249d8b1000afd2430c78d9/pa/JZ80953_d9af9e0e860cb4c4f556ffd202472596.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Elegant',
 'transmission': 'automatic',
 'trim': '2WD Elegant',
 'year': 2022}
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ80953%27 HTTP/1.1" 200 None
2026-03-28 11:30:58 [auto1.be] INFO: Saving data for JZ80953: {'created_time': 1774697458.715039, 'last_price_update_time': 1774697458.71505, 'auction_closing_time': 1774883764.0}
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ80953') HTTP/1.1" 204 0
2026-03-28 11:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_4f1725f801715401ff401052eb883d8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa430a310>
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fb8%252Fedb83c0ea3a366a7857044e8e7ba0cb7%252Fpa%252FUS61346_7a2c78a4b3819ef412d90cdf2e464bfd.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_7a2c78a4b3819ef412d90cdf2e464bfd.jpg saved to cache
2026-03-28 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff
2026-03-28 11:30:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1ad5b7d-f068-51af-b4b4-d8d71d053aff, skipping ID generation
2026-03-28 11:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff with scrape type 1
2026-03-28 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff sending to next pipeline
2026-03-28 11:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1ad5b7d-f068-51af-b4b4-d8d71d053aff, identifier: US61346
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41c61d0>
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_694ce225d40eb9819ed47a727a95793a.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_694ce225d40eb9819ed47a727a95793a.jpg saved to cache
2026-03-28 11:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b42d776-915d-5179-afd8-c2d3d89179cf
2026-03-28 11:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF15006> (referer: https://www.auto1.com/v1/car-details-view/AF15006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1ad5b7d-f068-51af-b4b4-d8d71d053aff with identifier: US61346
2026-03-28 11:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1ad5b7d-f068-51af-b4b4-d8d71d053aff with identifier: US61346
2026-03-28 11:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1ad5b7d-f068-51af-b4b4-d8d71d053aff with identifier: US61346 to the API
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_7a2c78a4b3819ef412d90cdf2e464bfd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:14:29Z',
 'fuel_type': 'diesel',
 'id': 'a1ad5b7d-f068-51af-b4b4-d8d71d053aff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US61346',
 'listing': 'auction',
 'location': 'BE, Strépy Bracquegnies (La Louviere)',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 65876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_f7cabe53b3f2e692729fd39e404752a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_7a2c78a4b3819ef412d90cdf2e464bfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_b2df60a13d5790f1cac6bd219b642cb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2945715,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_e57eb8d5d7685067e34c73722e4a70a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_1c614bbe293ca46eb070e3f286bd8e6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_24019e252defe81bddf0351577038ede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3108933,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_3974de0ccac0a6de9fc613eaaa2021f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2713510,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_7cd3bd57acde734985008fe54879091d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_df7ebd62aebf2ae6843a4e76b7d3fece.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ad5b7d-f068-51af-b4b4-d8d71d053aff/a1ad5b7d-f068-51af-b4b4-d8d71d053aff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/b8/edb83c0ea3a366a7857044e8e7ba0cb7/pa/US61346_b1ead19144a5846c6a3b6f4f5ee1f277.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61346%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [auto1.be] INFO: Saving data for US61346: {'created_time': 1774697459.290031, 'last_price_update_time': 1774697459.290042, 'auction_closing_time': 1774883669.0}
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='US61346') HTTP/1.1" 204 0
2026-03-28 11:30:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45435a5d-55bf-5d90-9521-d4c4d94d657a with identifier: TL44110
2026-03-28 11:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45435a5d-55bf-5d90-9521-d4c4d94d657a with scrape type 1
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 45435a5d-55bf-5d90-9521-d4c4d94d657a
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F58%252F5458a19a41d601298bb8a7b5151b88f9%252Fpa%252FTL44110_0e02e705179e35d1424238f76ad20d01.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_0e02e705179e35d1424238f76ad20d01.jpg not downloaded yet
2026-03-28 11:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41d3510>
2026-03-28 11:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_e9c4bb65bcf913dc89e0cb661ca664aa.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_e9c4bb65bcf913dc89e0cb661ca664aa.jpg saved to cache
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F58%252F5458a19a41d601298bb8a7b5151b88f9%252Fpa%252FTL44110_2c23737f91a933080c62d1a7467fa37e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_2c23737f91a933080c62d1a7467fa37e.jpg not downloaded yet
2026-03-28 11:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4197790>
2026-03-28 11:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_4f1725f801715401ff401052eb883d8a.jpg') HTTP/1.1" 204 0
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_4f1725f801715401ff401052eb883d8a.jpg saved to cache
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 708665a9-0358-5916-ac8f-c4940f6c0658
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F58%252F5458a19a41d601298bb8a7b5151b88f9%252Fpa%252FTL44110_54651788e303885c6961c7c479b8478a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_54651788e303885c6961c7c479b8478a.jpg not downloaded yet
2026-03-28 11:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ccfde9e-ced9-544b-b4ad-1e5d61052570 with identifier: AF15006
2026-03-28 11:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ccfde9e-ced9-544b-b4ad-1e5d61052570 with scrape type 1
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ccfde9e-ced9-544b-b4ad-1e5d61052570
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fcb%252F38cbd7b576f72730aa81ab2f6e793420%252Fpa%252FAF15006_756c949663bcfa1469fd30bc09b4d108.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_756c949663bcfa1469fd30bc09b4d108.jpg already downloaded
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fcb%252F38cbd7b576f72730aa81ab2f6e793420%252Fpa%252FAF15006_ef581e8430be790558328c5ff4ca22cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_ef581e8430be790558328c5ff4ca22cd.jpg already downloaded
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fcb%252F38cbd7b576f72730aa81ab2f6e793420%252Fpa%252FAF15006_ae0ff18fabfe523ec696326c82a2ccc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_ae0ff18fabfe523ec696326c82a2ccc6.jpg already downloaded
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fcb%252F38cbd7b576f72730aa81ab2f6e793420%252Fpa%252FAF15006_c5c2c6a4ccdcfa50760455544bb7bf19.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_c5c2c6a4ccdcfa50760455544bb7bf19.jpg already downloaded
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fcb%252F38cbd7b576f72730aa81ab2f6e793420%252Fpa%252FAF15006_1ef73fa09315c6c2c29f02cba827154a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_1ef73fa09315c6c2c29f02cba827154a.jpg already downloaded
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fcb%252F38cbd7b576f72730aa81ab2f6e793420%252Fpa%252FAF15006_99d80ae7c0ed6a61da043000ecd1113b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_99d80ae7c0ed6a61da043000ecd1113b.jpg already downloaded
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fcb%252F38cbd7b576f72730aa81ab2f6e793420%252Fpa%252FAF15006_3a1fff210d1d39d4dd1e6c826879c672.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_3a1fff210d1d39d4dd1e6c826879c672.jpg already downloaded
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fcb%252F38cbd7b576f72730aa81ab2f6e793420%252Fpa%252FAF15006_707562a8474cfe8cbaa9a8ebaaf095c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_707562a8474cfe8cbaa9a8ebaaf095c9.jpg already downloaded
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fcb%252F38cbd7b576f72730aa81ab2f6e793420%252Fpa%252FAF15006_ee79e0e042fcbe80e811c0831025645c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_ee79e0e042fcbe80e811c0831025645c.jpg already downloaded
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fcb%252F38cbd7b576f72730aa81ab2f6e793420%252Fpa%252FAF15006_bea18b967ad6c7a970096db429e9ff79.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_bea18b967ad6c7a970096db429e9ff79.jpg already downloaded
2026-03-28 11:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8ccfde9e-ced9-544b-b4ad-1e5d61052570, identifier: AF15006
2026-03-28 11:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8ccfde9e-ced9-544b-b4ad-1e5d61052570 with identifier: AF15006
2026-03-28 11:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8ccfde9e-ced9-544b-b4ad-1e5d61052570 with identifier: AF15006
2026-03-28 11:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8ccfde9e-ced9-544b-b4ad-1e5d61052570 with identifier: AF15006 to the API
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AF15006>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:32:58Z',
 'fuel_type': 'diesel',
 'id': '8ccfde9e-ced9-544b-b4ad-1e5d61052570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF15006',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 87492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_756c949663bcfa1469fd30bc09b4d108.jpg',
                'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_ef581e8430be790558328c5ff4ca22cd.jpg',
                'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_ae0ff18fabfe523ec696326c82a2ccc6.jpg',
                'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_c5c2c6a4ccdcfa50760455544bb7bf19.jpg',
                'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_1ef73fa09315c6c2c29f02cba827154a.jpg',
                'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_99d80ae7c0ed6a61da043000ecd1113b.jpg',
                'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_3a1fff210d1d39d4dd1e6c826879c672.jpg',
                'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_707562a8474cfe8cbaa9a8ebaaf095c9.jpg',
                'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_ee79e0e042fcbe80e811c0831025645c.jpg',
                'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_bea18b967ad6c7a970096db429e9ff79.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ccfde9e-ced9-544b-b4ad-1e5d61052570/8ccfde9e-ced9-544b-b4ad-1e5d61052570_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_756c949663bcfa1469fd30bc09b4d108.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ccfde9e-ced9-544b-b4ad-1e5d61052570/8ccfde9e-ced9-544b-b4ad-1e5d61052570_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_ef581e8430be790558328c5ff4ca22cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ccfde9e-ced9-544b-b4ad-1e5d61052570/8ccfde9e-ced9-544b-b4ad-1e5d61052570_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_ae0ff18fabfe523ec696326c82a2ccc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ccfde9e-ced9-544b-b4ad-1e5d61052570/8ccfde9e-ced9-544b-b4ad-1e5d61052570_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_c5c2c6a4ccdcfa50760455544bb7bf19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ccfde9e-ced9-544b-b4ad-1e5d61052570/8ccfde9e-ced9-544b-b4ad-1e5d61052570_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_1ef73fa09315c6c2c29f02cba827154a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ccfde9e-ced9-544b-b4ad-1e5d61052570/8ccfde9e-ced9-544b-b4ad-1e5d61052570_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_99d80ae7c0ed6a61da043000ecd1113b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ccfde9e-ced9-544b-b4ad-1e5d61052570/8ccfde9e-ced9-544b-b4ad-1e5d61052570_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_3a1fff210d1d39d4dd1e6c826879c672.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ccfde9e-ced9-544b-b4ad-1e5d61052570/8ccfde9e-ced9-544b-b4ad-1e5d61052570_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_707562a8474cfe8cbaa9a8ebaaf095c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ccfde9e-ced9-544b-b4ad-1e5d61052570/8ccfde9e-ced9-544b-b4ad-1e5d61052570_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_ee79e0e042fcbe80e811c0831025645c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ccfde9e-ced9-544b-b4ad-1e5d61052570/8ccfde9e-ced9-544b-b4ad-1e5d61052570_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/cb/38cbd7b576f72730aa81ab2f6e793420/pa/AF15006_bea18b967ad6c7a970096db429e9ff79.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2022}
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF15006%27 HTTP/1.1" 200 None
2026-03-28 11:31:00 [auto1.be] INFO: Saving data for AF15006: {'created_time': 1774697460.013723, 'last_price_update_time': 1774697460.013734, 'auction_closing_time': 1774884778.0}
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AF15006') HTTP/1.1" 204 0
2026-03-28 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_795784fe8e19048cbc7d4a9b5458cb54.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F58%252F5458a19a41d601298bb8a7b5151b88f9%252Fpa%252FTL44110_75e9074956cad435befc01276c368427.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_75e9074956cad435befc01276c368427.jpg not downloaded yet
2026-03-28 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_7bd1c372209637490877d057684e8e9b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_aa6bacc5f6f940ad5d24f0ea14a8d429.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_2003dcd9ebe31e6fe8f0f5dca0c5cc8f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F58%252F5458a19a41d601298bb8a7b5151b88f9%252Fpa%252FTL44110_61a5e6c54b22a35e3012aa998e7b5fe9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_61a5e6c54b22a35e3012aa998e7b5fe9.jpg not downloaded yet
2026-03-28 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_f2c8b252dcd69bfa61d458e82a9caebb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_13f7f4f190b74389b4bf1263b1ae9492.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_55e86dd84fa1457132cc5d1e73d07bae.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_39aaeac74692bfc6b84c18e0801e0028.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_97255c87445fc98e51ee1492ef1be37c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42ff290>
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_795784fe8e19048cbc7d4a9b5458cb54.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_795784fe8e19048cbc7d4a9b5458cb54.jpg saved to cache
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d927ef0d-1f06-57f7-8d01-f304e031bd35
2026-03-28 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_54651788e303885c6961c7c479b8478a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_2c23737f91a933080c62d1a7467fa37e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_0e02e705179e35d1424238f76ad20d01.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa420c0d0>
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_7bd1c372209637490877d057684e8e9b.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_7bd1c372209637490877d057684e8e9b.jpg saved to cache
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d927ef0d-1f06-57f7-8d01-f304e031bd35
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa411dad0>
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_aa6bacc5f6f940ad5d24f0ea14a8d429.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_aa6bacc5f6f940ad5d24f0ea14a8d429.jpg saved to cache
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b42d776-915d-5179-afd8-c2d3d89179cf
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42ed350>
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_2003dcd9ebe31e6fe8f0f5dca0c5cc8f.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_2003dcd9ebe31e6fe8f0f5dca0c5cc8f.jpg saved to cache
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a
2026-03-28 11:31:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42ecbd0>
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_f2c8b252dcd69bfa61d458e82a9caebb.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_f2c8b252dcd69bfa61d458e82a9caebb.jpg saved to cache
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a
2026-03-28 11:31:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41f5f50>
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F04%252F02043619a8fed1f8bb4344439aa20ad2%252Fpa%252FRX31058_13f7f4f190b74389b4bf1263b1ae9492.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_13f7f4f190b74389b4bf1263b1ae9492.jpg saved to cache
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 708665a9-0358-5916-ac8f-c4940f6c0658
2026-03-28 11:31:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 708665a9-0358-5916-ac8f-c4940f6c0658, skipping ID generation
2026-03-28 11:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 708665a9-0358-5916-ac8f-c4940f6c0658 with scrape type 1
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 708665a9-0358-5916-ac8f-c4940f6c0658 sending to next pipeline
2026-03-28 11:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 708665a9-0358-5916-ac8f-c4940f6c0658, identifier: RX31058
2026-03-28 11:31:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42396d0>
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_55e86dd84fa1457132cc5d1e73d07bae.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_55e86dd84fa1457132cc5d1e73d07bae.jpg saved to cache
2026-03-28 11:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d927ef0d-1f06-57f7-8d01-f304e031bd35
2026-03-28 11:31:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41f47d0>
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_39aaeac74692bfc6b84c18e0801e0028.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_39aaeac74692bfc6b84c18e0801e0028.jpg saved to cache
2026-03-28 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b42d776-915d-5179-afd8-c2d3d89179cf
2026-03-28 11:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa420e790>
2026-03-28 11:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F20%252F2f20447229f7781b3a14f276529a1512%252Fpa%252FRF01360_97255c87445fc98e51ee1492ef1be37c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_97255c87445fc98e51ee1492ef1be37c.jpg saved to cache
2026-03-28 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d927ef0d-1f06-57f7-8d01-f304e031bd35
2026-03-28 11:31:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d927ef0d-1f06-57f7-8d01-f304e031bd35, skipping ID generation
2026-03-28 11:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d927ef0d-1f06-57f7-8d01-f304e031bd35 with scrape type 1
2026-03-28 11:31:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d927ef0d-1f06-57f7-8d01-f304e031bd35 sending to next pipeline
2026-03-28 11:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d927ef0d-1f06-57f7-8d01-f304e031bd35, identifier: RF01360
2026-03-28 11:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_ebc0f21fe1adacb89c3d6e4cd5ef2678.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 708665a9-0358-5916-ac8f-c4940f6c0658 with identifier: RX31058
2026-03-28 11:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 708665a9-0358-5916-ac8f-c4940f6c0658 with identifier: RX31058
2026-03-28 11:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 708665a9-0358-5916-ac8f-c4940f6c0658 with identifier: RX31058 to the API
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_13f7f4f190b74389b4bf1263b1ae9492.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:34:09Z',
 'fuel_type': 'diesel',
 'id': '708665a9-0358-5916-ac8f-c4940f6c0658',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX31058',
 'listing': 'auction',
 'location': 'BE, Gent',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 144408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_4f1725f801715401ff401052eb883d8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_a4e3fb405658514685d3321880c68802.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_aa9579863e6d675a1eacfc7def04514e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2392847,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_13f7f4f190b74389b4bf1263b1ae9492.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_5785011febbd8e395d8fbb9cb951e93e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_9447ccf0d7b87f48fb415022051d6150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_2b001672979ab28e61ca52a61e8ba8ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_7338d63b9d24e05019d10abbf208775d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_1501785d6842f43f8f6df74319b48c84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_708665a9-0358-5916-ac8f-c4940f6c0658/708665a9-0358-5916-ac8f-c4940f6c0658_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/04/02043619a8fed1f8bb4344439aa20ad2/pa/RX31058_c43685ffc8a4972f8da97210800d3fe4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-12',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi L1H1 2,9t Expression',
 'transmission': 'manual',
 'trim': 'L1H1 2,9t Expression',
 'year': 2017}
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX31058%27 HTTP/1.1" 200 None
2026-03-28 11:31:01 [auto1.be] INFO: Saving data for RX31058: {'created_time': 1774697461.515532, 'last_price_update_time': 1774697461.515544, 'auction_closing_time': 1774884849.0}
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RX31058') HTTP/1.1" 204 0
2026-03-28 11:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d927ef0d-1f06-57f7-8d01-f304e031bd35 with identifier: RF01360
2026-03-28 11:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d927ef0d-1f06-57f7-8d01-f304e031bd35 with identifier: RF01360
2026-03-28 11:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d927ef0d-1f06-57f7-8d01-f304e031bd35 with identifier: RF01360 to the API
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_97255c87445fc98e51ee1492ef1be37c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:10:59Z',
 'fuel_type': 'petrol',
 'id': 'd927ef0d-1f06-57f7-8d01-f304e031bd35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF01360',
 'listing': 'auction',
 'location': 'BE, Vilvoorde',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 49794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_97255c87445fc98e51ee1492ef1be37c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_7bd1c372209637490877d057684e8e9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_cf2d9959a11607f3223269e690ffe8a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_83cac5a8574834062eefbe2a884ba22a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2469726,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_55e86dd84fa1457132cc5d1e73d07bae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2517461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_795784fe8e19048cbc7d4a9b5458cb54.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_157a90bf6d894c2998b9f804089fe2d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2614907,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_af2720342e268bb8f7334618c9cac541.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537802,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_985f7c70a3579a055e2d59bcbcff1f0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d927ef0d-1f06-57f7-8d01-f304e031bd35/d927ef0d-1f06-57f7-8d01-f304e031bd35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/20/2f20447229f7781b3a14f276529a1512/pa/RF01360_f1e8c32c07f12281d1af3366bea1a560.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Elite Start/Stop',
 'transmission': 'manual',
 'trim': 'Elite Start/Stop',
 'year': 2019}
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF01360%27 HTTP/1.1" 200 None
2026-03-28 11:31:01 [auto1.be] INFO: Saving data for RF01360: {'created_time': 1774697461.93442, 'last_price_update_time': 1774697461.934435, 'auction_closing_time': 1774883459.0}
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RF01360') HTTP/1.1" 204 0
2026-03-28 11:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_95b8b71c8f0b5352d3d4aefb2a56b7cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV16828> (referer: https://www.auto1.com/v1/car-details-view/AV16828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa44ad390>
2026-03-28 11:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45435a5d-55bf-5d90-9521-d4c4d94d657a/45435a5d-55bf-5d90-9521-d4c4d94d657a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F58%252F5458a19a41d601298bb8a7b5151b88f9%252Fpa%252FTL44110_54651788e303885c6961c7c479b8478a.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_54651788e303885c6961c7c479b8478a.jpg saved to cache
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45435a5d-55bf-5d90-9521-d4c4d94d657a
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4472190>
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45435a5d-55bf-5d90-9521-d4c4d94d657a/45435a5d-55bf-5d90-9521-d4c4d94d657a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F58%252F5458a19a41d601298bb8a7b5151b88f9%252Fpa%252FTL44110_2c23737f91a933080c62d1a7467fa37e.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_2c23737f91a933080c62d1a7467fa37e.jpg saved to cache
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45435a5d-55bf-5d90-9521-d4c4d94d657a
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa442c210>
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45435a5d-55bf-5d90-9521-d4c4d94d657a/45435a5d-55bf-5d90-9521-d4c4d94d657a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F58%252F5458a19a41d601298bb8a7b5151b88f9%252Fpa%252FTL44110_0e02e705179e35d1424238f76ad20d01.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_0e02e705179e35d1424238f76ad20d01.jpg saved to cache
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45435a5d-55bf-5d90-9521-d4c4d94d657a
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa411f790>
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F0f%252F9a0fd5e071236ae537e1f7132039326d%252Fpa%252FUU14069_ebc0f21fe1adacb89c3d6e4cd5ef2678.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_ebc0f21fe1adacb89c3d6e4cd5ef2678.jpg saved to cache
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a
2026-03-28 11:31:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ffbf2b1-14dd-5735-8e53-bae43c978d2a, skipping ID generation
2026-03-28 11:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a with scrape type 1
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a sending to next pipeline
2026-03-28 11:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ffbf2b1-14dd-5735-8e53-bae43c978d2a, identifier: UU14069
2026-03-28 11:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ffbf2b1-14dd-5735-8e53-bae43c978d2a with identifier: UU14069
2026-03-28 11:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ffbf2b1-14dd-5735-8e53-bae43c978d2a with identifier: UU14069
2026-03-28 11:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ffbf2b1-14dd-5735-8e53-bae43c978d2a with identifier: UU14069 to the API
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_ebc0f21fe1adacb89c3d6e4cd5ef2678.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:52:16Z',
 'fuel_type': 'diesel',
 'id': '2ffbf2b1-14dd-5735-8e53-bae43c978d2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU14069',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 157400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_12c92904fded2eab1498444025bf2d38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2799814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_37934075ca58bfdff7af8cd74709a295.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_3093f74b96ec9c2c45bf47a57a182087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2980403,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_271a285a7375008f9497ac668e4a8eaf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2831055,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_69c71fbca070b1e9b4878c2266d3f2b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_ebc0f21fe1adacb89c3d6e4cd5ef2678.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_2003dcd9ebe31e6fe8f0f5dca0c5cc8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_e9c4bb65bcf913dc89e0cb661ca664aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_2edf8db05c60f934a544f4e5142a0631.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffbf2b1-14dd-5735-8e53-bae43c978d2a/2ffbf2b1-14dd-5735-8e53-bae43c978d2a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2969758,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/0f/9a0fd5e071236ae537e1f7132039326d/pa/UU14069_f2c8b252dcd69bfa61d458e82a9caebb.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-10',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2017}
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU14069%27 HTTP/1.1" 200 None
2026-03-28 11:31:02 [auto1.be] INFO: Saving data for UU14069: {'created_time': 1774697462.602306, 'last_price_update_time': 1774697462.602316, 'auction_closing_time': 1774885936.0}
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UU14069') HTTP/1.1" 204 0
2026-03-28 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_75e9074956cad435befc01276c368427.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_61a5e6c54b22a35e3012aa998e7b5fe9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_3811d0a2d0500dde47a8a25dc455601a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_1a565def4e55d7bb8a0be79b522d7ff1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa44895d0>
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_95b8b71c8f0b5352d3d4aefb2a56b7cc.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_95b8b71c8f0b5352d3d4aefb2a56b7cc.jpg saved to cache
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c308775-4db8-55d1-af91-dc9daebcc7bf
2026-03-28 11:31:02 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa4a4c64-279c-59a3-807e-1867f67bd6a1 with identifier: AV16828
2026-03-28 11:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa4a4c64-279c-59a3-807e-1867f67bd6a1 with scrape type 1
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa4a4c64-279c-59a3-807e-1867f67bd6a1
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_dc7e563d33d04227f8dc16418dd9da40.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_dc7e563d33d04227f8dc16418dd9da40.jpg not downloaded yet
2026-03-28 11:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_67a313f2ae624e76bf1ea3081dd76b14.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-28 11:31:02 [auto1.be] INFO: Scrape type for ML85388: 0
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: GT24920
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: CK78813
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: FL07479
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: KV70453
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-28 11:31:02 [auto1.be] INFO: Scrape type for WU67286: 0
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: XB51767
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB51767%27 HTTP/1.1" 200 None
2026-03-28 11:31:02 [auto1.be] INFO: Scrape type for XB51767: 0
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: CT01503
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT01503%27 HTTP/1.1" 200 None
2026-03-28 11:31:02 [auto1.be] INFO: Scrape type for CT01503: 0
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: BT18330
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: GU08126
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GU08126%27 HTTP/1.1" 200 None
2026-03-28 11:31:02 [auto1.be] INFO: Scrape type for GU08126: 0
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-28 11:31:02 [auto1.be] INFO: Scrape type for VA07887: 0
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: JF01400
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: XR56379
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR56379%27 HTTP/1.1" 200 None
2026-03-28 11:31:02 [auto1.be] INFO: Scrape type for XR56379: 0
2026-03-28 11:31:02 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-28 11:31:02 [auto1.be] INFO: Scrape type for MB19665: 2
2026-03-28 11:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 088821b5-26e9-5a2f-8721-8916b6110d40 with identifier: MB19665
2026-03-28 11:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 088821b5-26e9-5a2f-8721-8916b6110d40 with scrape type 2
2026-03-28 11:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 088821b5-26e9-5a2f-8721-8916b6110d40 with scrape type 2
2026-03-28 11:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 088821b5-26e9-5a2f-8721-8916b6110d40, identifier: MB19665
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_b59ba82f8ff143c839937fbb0cfa03e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_b59ba82f8ff143c839937fbb0cfa03e3.jpg not downloaded yet
2026-03-28 11:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 088821b5-26e9-5a2f-8721-8916b6110d40 with identifier: MB19665
2026-03-28 11:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 088821b5-26e9-5a2f-8721-8916b6110d40 with identifier: MB19665
2026-03-28 11:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 088821b5-26e9-5a2f-8721-8916b6110d40 with identifier: MB19665 to the API
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:42:29Z',
 'fuel_type': 'diesel',
 'id': '088821b5-26e9-5a2f-8721-8916b6110d40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB19665',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 102364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-02',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-28 11:31:03 [auto1.be] INFO: Saving data for MB19665: {'auction_closing_time': 1774716149.0, 'created_time': 1774513891.479441, 'last_price_update_time': 1774697463.363642}
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MB19665') HTTP/1.1" 204 0
2026-03-28 11:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_45b3ac13d7826f934c74076093dff3d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: VL13165
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-28 11:31:03 [auto1.be] INFO: Scrape type for TW09601: 0
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-28 11:31:03 [auto1.be] INFO: Scrape type for CN47453: 0
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: KV74957
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: YB46987
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56663%27 HTTP/1.1" 200 None
2026-03-28 11:31:03 [auto1.be] INFO: Scrape type for CW56663: 0
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: UZ05678
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ05678%27 HTTP/1.1" 200 None
2026-03-28 11:31:03 [auto1.be] INFO: Scrape type for UZ05678: 0
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: YJ37534
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: TY97185
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: WX02409
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX02409%27 HTTP/1.1" 200 None
2026-03-28 11:31:03 [auto1.be] INFO: Scrape type for WX02409: 0
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: AV10256
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV10256%27 HTTP/1.1" 200 None
2026-03-28 11:31:03 [auto1.be] INFO: Scrape type for AV10256: 0
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: TA63870
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA63870%27 HTTP/1.1" 200 None
2026-03-28 11:31:03 [auto1.be] INFO: Scrape type for TA63870: 0
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: CG04214
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: MV08230
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV08230%27 HTTP/1.1" 200 None
2026-03-28 11:31:03 [auto1.be] INFO: Scrape type for MV08230: 0
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: BH51844
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: DZ18869
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-28 11:31:03 [auto1.be] INFO: Scrape type for VM79296: 0
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-28 11:31:03 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-28 11:31:03 [auto1.be] INFO: Scrape type for GN45273: 2
2026-03-28 11:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827 with identifier: GN45273
2026-03-28 11:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827 with scrape type 2
2026-03-28 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827 with scrape type 2
2026-03-28 11:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827, identifier: GN45273
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_315d7bd771c87ac3a0087adf82598f5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_315d7bd771c87ac3a0087adf82598f5a.jpg not downloaded yet
2026-03-28 11:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_4f8e4e7050273f6c7fa2ed17487de39e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827 with identifier: GN45273
2026-03-28 11:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827 with identifier: GN45273
2026-03-28 11:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827 with identifier: GN45273 to the API
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:19:06Z',
 'fuel_type': 'diesel',
 'id': 'b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN45273',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 180175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-27',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2015}
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-28 11:31:04 [auto1.be] INFO: Saving data for GN45273: {'auction_closing_time': 1774714746.0, 'created_time': 1774513859.61091, 'last_price_update_time': 1774697464.065754}
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GN45273') HTTP/1.1" 204 0
2026-03-28 11:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e8c310>
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45435a5d-55bf-5d90-9521-d4c4d94d657a/45435a5d-55bf-5d90-9521-d4c4d94d657a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F58%252F5458a19a41d601298bb8a7b5151b88f9%252Fpa%252FTL44110_75e9074956cad435befc01276c368427.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_75e9074956cad435befc01276c368427.jpg saved to cache
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45435a5d-55bf-5d90-9521-d4c4d94d657a
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41d8b10>
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45435a5d-55bf-5d90-9521-d4c4d94d657a/45435a5d-55bf-5d90-9521-d4c4d94d657a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F58%252F5458a19a41d601298bb8a7b5151b88f9%252Fpa%252FTL44110_61a5e6c54b22a35e3012aa998e7b5fe9.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_61a5e6c54b22a35e3012aa998e7b5fe9.jpg saved to cache
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45435a5d-55bf-5d90-9521-d4c4d94d657a
2026-03-28 11:31:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45435a5d-55bf-5d90-9521-d4c4d94d657a, skipping ID generation
2026-03-28 11:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45435a5d-55bf-5d90-9521-d4c4d94d657a with scrape type 1
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45435a5d-55bf-5d90-9521-d4c4d94d657a sending to next pipeline
2026-03-28 11:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45435a5d-55bf-5d90-9521-d4c4d94d657a, identifier: TL44110
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa40d3bd0>
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_3811d0a2d0500dde47a8a25dc455601a.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_3811d0a2d0500dde47a8a25dc455601a.jpg saved to cache
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c308775-4db8-55d1-af91-dc9daebcc7bf
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e40090>
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_1a565def4e55d7bb8a0be79b522d7ff1.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_1a565def4e55d7bb8a0be79b522d7ff1.jpg saved to cache
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c308775-4db8-55d1-af91-dc9daebcc7bf
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa40d3690>
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_67a313f2ae624e76bf1ea3081dd76b14.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_67a313f2ae624e76bf1ea3081dd76b14.jpg saved to cache
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b72da8e-378d-5b38-bbba-a33071818563
2026-03-28 11:31:04 [auto1.be] INFO: Found listing with ID: PC57264
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_aefd21541d1ae4fd807558516fc93648.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_aefd21541d1ae4fd807558516fc93648.jpg not downloaded yet
2026-03-28 11:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45435a5d-55bf-5d90-9521-d4c4d94d657a with identifier: TL44110
2026-03-28 11:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45435a5d-55bf-5d90-9521-d4c4d94d657a with identifier: TL44110
2026-03-28 11:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45435a5d-55bf-5d90-9521-d4c4d94d657a with identifier: TL44110 to the API
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_61a5e6c54b22a35e3012aa998e7b5fe9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:30:01Z',
 'fuel_type': 'diesel',
 'id': '45435a5d-55bf-5d90-9521-d4c4d94d657a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL44110',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 174075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45435a5d-55bf-5d90-9521-d4c4d94d657a/45435a5d-55bf-5d90-9521-d4c4d94d657a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_0e02e705179e35d1424238f76ad20d01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45435a5d-55bf-5d90-9521-d4c4d94d657a/45435a5d-55bf-5d90-9521-d4c4d94d657a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_2c23737f91a933080c62d1a7467fa37e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45435a5d-55bf-5d90-9521-d4c4d94d657a/45435a5d-55bf-5d90-9521-d4c4d94d657a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_54651788e303885c6961c7c479b8478a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45435a5d-55bf-5d90-9521-d4c4d94d657a/45435a5d-55bf-5d90-9521-d4c4d94d657a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_75e9074956cad435befc01276c368427.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45435a5d-55bf-5d90-9521-d4c4d94d657a/45435a5d-55bf-5d90-9521-d4c4d94d657a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/58/5458a19a41d601298bb8a7b5151b88f9/pa/TL44110_61a5e6c54b22a35e3012aa998e7b5fe9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Tendance',
 'transmission': 'automatic',
 'trim': 'Tendance',
 'year': 2012}
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL44110%27 HTTP/1.1" 200 None
2026-03-28 11:31:04 [auto1.be] INFO: Saving data for TL44110: {'created_time': 1774697464.855446, 'last_price_update_time': 1774697464.855459, 'auction_closing_time': 1774884601.0}
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TL44110') HTTP/1.1" 204 0
2026-03-28 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_c685d027391d6fc16fb692216249c2f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4259e10>
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_45b3ac13d7826f934c74076093dff3d2.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_45b3ac13d7826f934c74076093dff3d2.jpg saved to cache
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b72da8e-378d-5b38-bbba-a33071818563
2026-03-28 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_a6741eee6d6ca1eadf833444ead3f0df.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_dc5be695cd8fd4bc1dcaedcf2ec5b536.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_dc5be695cd8fd4bc1dcaedcf2ec5b536.jpg not downloaded yet
2026-03-28 11:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_20c27bfe5316f5e6473bb3607cd3c897.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d8a110>
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_4f8e4e7050273f6c7fa2ed17487de39e.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_4f8e4e7050273f6c7fa2ed17487de39e.jpg saved to cache
2026-03-28 11:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b72da8e-378d-5b38-bbba-a33071818563
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_7fe758ec9bdd96de1513534ea8025332.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_7fe758ec9bdd96de1513534ea8025332.jpg not downloaded yet
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_167e8aea1731feeb7db9ae1cb129facf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_167e8aea1731feeb7db9ae1cb129facf.jpg not downloaded yet
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa421fa50>
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa5%252Fc4a545bd44b9b6fe94e69a5342b7d7e1%252Fpa%252FBB55914_c685d027391d6fc16fb692216249c2f9.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_c685d027391d6fc16fb692216249c2f9.jpg saved to cache
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55ab384c-2a36-59f4-a817-e36c5a40c743
2026-03-28 11:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55ab384c-2a36-59f4-a817-e36c5a40c743, skipping ID generation
2026-03-28 11:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55ab384c-2a36-59f4-a817-e36c5a40c743 with scrape type 1
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55ab384c-2a36-59f4-a817-e36c5a40c743 sending to next pipeline
2026-03-28 11:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 55ab384c-2a36-59f4-a817-e36c5a40c743, identifier: BB55914
2026-03-28 11:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 55ab384c-2a36-59f4-a817-e36c5a40c743 with identifier: BB55914
2026-03-28 11:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 55ab384c-2a36-59f4-a817-e36c5a40c743 with identifier: BB55914
2026-03-28 11:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 55ab384c-2a36-59f4-a817-e36c5a40c743 with identifier: BB55914 to the API
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_c685d027391d6fc16fb692216249c2f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 392,
 'expiration_date': '2026-03-30T15:45:09Z',
 'fuel_type': 'hybrid',
 'id': '55ab384c-2a36-59f4-a817-e36c5a40c743',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB55914',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 47318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_c685d027391d6fc16fb692216249c2f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2645897,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_39b450b3b0d5edb0ad5dd734b8c03e10.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2637106,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_ed3227dabb20510766bfa70c1fb289fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2558027,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_7d0ed2438a89539e09fb11fb5bef7852.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2615880,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_8e430541660d9f596179d008183a51d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2672559,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_f41e8c95909bc98e515e71eec1e3f792.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570611,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_8663d702d942438aa3a0c3d347dad47c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_bc7681a2a2e0b0dfae812d67272e9d85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_ef4acd5f360923478e7aaee64d0f70ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ab384c-2a36-59f4-a817-e36c5a40c743/55ab384c-2a36-59f4-a817-e36c5a40c743_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a5/c4a545bd44b9b6fe94e69a5342b7d7e1/pa/BB55914_64dbf2959885298cc75a63b3e64ba866.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 T8 Plug-in Hybrid R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2020}
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB55914%27 HTTP/1.1" 200 None
2026-03-28 11:31:05 [auto1.be] INFO: Saving data for BB55914: {'created_time': 1774697465.521237, 'last_price_update_time': 1774697465.521248, 'auction_closing_time': 1774885509.0}
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BB55914') HTTP/1.1" 204 0
2026-03-28 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_0509085e6137e071cb032bd90f27319c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_3c3d6d13fcc8536cf80ba2dd04f6ce4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_3c3d6d13fcc8536cf80ba2dd04f6ce4b.jpg not downloaded yet
2026-03-28 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_dc7e563d33d04227f8dc16418dd9da40.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_ed3f7f0b30f06dbed239c3cd34999879.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_618b16afa282dff25e17a08fca2fd07a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_618b16afa282dff25e17a08fca2fd07a.jpg not downloaded yet
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa421cd90>
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_a6741eee6d6ca1eadf833444ead3f0df.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_a6741eee6d6ca1eadf833444ead3f0df.jpg saved to cache
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4348a1dc-8057-530c-a3dd-516db4e90c09
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e3f6d0>
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_20c27bfe5316f5e6473bb3607cd3c897.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_20c27bfe5316f5e6473bb3607cd3c897.jpg saved to cache
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4348a1dc-8057-530c-a3dd-516db4e90c09
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_433a82783099dae7446393896c7cde01.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_433a82783099dae7446393896c7cde01.jpg not downloaded yet
2026-03-28 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_b59ba82f8ff143c839937fbb0cfa03e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4239b50>
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_0509085e6137e071cb032bd90f27319c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_0509085e6137e071cb032bd90f27319c.jpg saved to cache
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4348a1dc-8057-530c-a3dd-516db4e90c09
2026-03-28 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_315d7bd771c87ac3a0087adf82598f5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_aefd21541d1ae4fd807558516fc93648.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV57254> (referer: https://www.auto1.com/v1/car-details-view/TV57254/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN32494> (referer: https://www.auto1.com/v1/car-details-view/GN32494/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4437ed0>
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_dc7e563d33d04227f8dc16418dd9da40.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_dc7e563d33d04227f8dc16418dd9da40.jpg saved to cache
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa4a4c64-279c-59a3-807e-1867f67bd6a1
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42bb910>
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_ed3f7f0b30f06dbed239c3cd34999879.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_ed3f7f0b30f06dbed239c3cd34999879.jpg saved to cache
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4348a1dc-8057-530c-a3dd-516db4e90c09
2026-03-28 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_1c61f7394557fef72bd806bd4e2dc843.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4ea8cd0>
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_b59ba82f8ff143c839937fbb0cfa03e3.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_b59ba82f8ff143c839937fbb0cfa03e3.jpg saved to cache
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa4a4c64-279c-59a3-807e-1867f67bd6a1
2026-03-28 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_240509a80766a54da06ec44b37fea245.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_167e8aea1731feeb7db9ae1cb129facf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_3c3d6d13fcc8536cf80ba2dd04f6ce4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d4ff50>
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_315d7bd771c87ac3a0087adf82598f5a.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_315d7bd771c87ac3a0087adf82598f5a.jpg saved to cache
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa4a4c64-279c-59a3-807e-1867f67bd6a1
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4482790>
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_aefd21541d1ae4fd807558516fc93648.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_aefd21541d1ae4fd807558516fc93648.jpg saved to cache
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa4a4c64-279c-59a3-807e-1867f67bd6a1
2026-03-28 11:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c34719b-6f0b-5dce-9c50-d8ca13e51f75 with identifier: TV57254
2026-03-28 11:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75 with scrape type 1
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_eb6e7432ea18b8d1497d912744ca2c9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_eb6e7432ea18b8d1497d912744ca2c9c.jpg not downloaded yet
2026-03-28 11:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 842db12f-e1ec-585c-a241-9fbc250f20de with identifier: GN32494
2026-03-28 11:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 842db12f-e1ec-585c-a241-9fbc250f20de with scrape type 1
2026-03-28 11:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 842db12f-e1ec-585c-a241-9fbc250f20de
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F84%252F5f8472e245ec27f2e6b58f94b41fb3e0%252Fpa%252FGN32494_38d034b1e18a01e17551d1e5f416dd5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_38d034b1e18a01e17551d1e5f416dd5e.jpg not downloaded yet
2026-03-28 11:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_dee88b2ed8b44ad536c93f20ede21b68.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_94d6b3b2f465168f902d3a25f917aa28.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_94d6b3b2f465168f902d3a25f917aa28.jpg not downloaded yet
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F84%252F5f8472e245ec27f2e6b58f94b41fb3e0%252Fpa%252FGN32494_ed13cb79716cf6439ba86b69e93d3b8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_ed13cb79716cf6439ba86b69e93d3b8e.jpg not downloaded yet
2026-03-28 11:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_7113cab526fe7e24d966013b1bca0487.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_618b16afa282dff25e17a08fca2fd07a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_fb7786df59c569b86b70f477982444f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_fb7786df59c569b86b70f477982444f4.jpg not downloaded yet
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F84%252F5f8472e245ec27f2e6b58f94b41fb3e0%252Fpa%252FGN32494_355677133beedc8bd9d42bd4ede9dcd8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_355677133beedc8bd9d42bd4ede9dcd8.jpg not downloaded yet
2026-03-28 11:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH04328> (referer: https://www.auto1.com/v1/car-details-view/KH04328/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa410d450>
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_1c61f7394557fef72bd806bd4e2dc843.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_1c61f7394557fef72bd806bd4e2dc843.jpg saved to cache
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b72da8e-378d-5b38-bbba-a33071818563
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42d6750>
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_240509a80766a54da06ec44b37fea245.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_240509a80766a54da06ec44b37fea245.jpg saved to cache
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4348a1dc-8057-530c-a3dd-516db4e90c09
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4ccf750>
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_167e8aea1731feeb7db9ae1cb129facf.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_167e8aea1731feeb7db9ae1cb129facf.jpg saved to cache
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa4a4c64-279c-59a3-807e-1867f67bd6a1
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa439e910>
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_3c3d6d13fcc8536cf80ba2dd04f6ce4b.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_3c3d6d13fcc8536cf80ba2dd04f6ce4b.jpg saved to cache
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa4a4c64-279c-59a3-807e-1867f67bd6a1
2026-03-28 11:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_433a82783099dae7446393896c7cde01.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_dc5be695cd8fd4bc1dcaedcf2ec5b536.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_73434a772e733f5b7f31e5959c30c854.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_91a9251a4669826f85c54ed7eb96b7a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_91a9251a4669826f85c54ed7eb96b7a5.jpg not downloaded yet
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F84%252F5f8472e245ec27f2e6b58f94b41fb3e0%252Fpa%252FGN32494_c714de09f77efc59af647411d5975daa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_c714de09f77efc59af647411d5975daa.jpg not downloaded yet
2026-03-28 11:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_26636feaf2a49ef97a46de54d149c3a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_aa5c194adf6328d676de223e1d911188.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_aa5c194adf6328d676de223e1d911188.jpg not downloaded yet
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F84%252F5f8472e245ec27f2e6b58f94b41fb3e0%252Fpa%252FGN32494_63c21528a7d4cb729b0d32e0ec227b2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_63c21528a7d4cb729b0d32e0ec227b2a.jpg not downloaded yet
2026-03-28 11:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_211cb053f601c08f5a55faa0c9f7cdf6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4237e50>
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F40%252F0340b7a7cd0a7cf26895537d842886e2%252Fpa%252FST29091_dee88b2ed8b44ad536c93f20ede21b68.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_dee88b2ed8b44ad536c93f20ede21b68.jpg saved to cache
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b72da8e-378d-5b38-bbba-a33071818563
2026-03-28 11:31:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b72da8e-378d-5b38-bbba-a33071818563, skipping ID generation
2026-03-28 11:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b72da8e-378d-5b38-bbba-a33071818563 with scrape type 1
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b72da8e-378d-5b38-bbba-a33071818563 sending to next pipeline
2026-03-28 11:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5b72da8e-378d-5b38-bbba-a33071818563, identifier: ST29091
2026-03-28 11:31:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4cfcbd0>
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_7113cab526fe7e24d966013b1bca0487.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_7113cab526fe7e24d966013b1bca0487.jpg saved to cache
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c308775-4db8-55d1-af91-dc9daebcc7bf
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42b2910>
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_618b16afa282dff25e17a08fca2fd07a.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_618b16afa282dff25e17a08fca2fd07a.jpg saved to cache
2026-03-28 11:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa4a4c64-279c-59a3-807e-1867f67bd6a1
2026-03-28 11:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b05f4bf-3759-5498-b72a-8efaf507fc8e with identifier: KH04328
2026-03-28 11:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e with scrape type 1
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_ec4df0696d9e08aa14238d688345398d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_ec4df0696d9e08aa14238d688345398d.jpg not downloaded yet
2026-03-28 11:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_1238f5ee79344947cd64d27086f8db46.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_3b292a3cad8c78ddd97dea9fcb894d0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_3b292a3cad8c78ddd97dea9fcb894d0a.jpg not downloaded yet
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F84%252F5f8472e245ec27f2e6b58f94b41fb3e0%252Fpa%252FGN32494_6bdbc3cc57935dcc27646984f058764a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_6bdbc3cc57935dcc27646984f058764a.jpg not downloaded yet
2026-03-28 11:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5b72da8e-378d-5b38-bbba-a33071818563 with identifier: ST29091
2026-03-28 11:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5b72da8e-378d-5b38-bbba-a33071818563 with identifier: ST29091
2026-03-28 11:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5b72da8e-378d-5b38-bbba-a33071818563 with identifier: ST29091 to the API
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_dee88b2ed8b44ad536c93f20ede21b68.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:21:12Z',
 'fuel_type': 'diesel',
 'id': '5b72da8e-378d-5b38-bbba-a33071818563',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST29091',
 'listing': 'auction',
 'location': 'BE, Aarschot',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 146362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_45b3ac13d7826f934c74076093dff3d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2462901,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_9f4b3abee180cd75fb14607b607203a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_4f8e4e7050273f6c7fa2ed17487de39e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_67a313f2ae624e76bf1ea3081dd76b14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_97280cee7cbfa96a44815fef57ba6022.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2647372,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_dee88b2ed8b44ad536c93f20ede21b68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2529257,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_1c61f7394557fef72bd806bd4e2dc843.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_18e718ce35658d86e2a161913d98ea5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_1cec35cc0351ce0f8042c1424d494d75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b72da8e-378d-5b38-bbba-a33071818563/5b72da8e-378d-5b38-bbba-a33071818563_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/40/0340b7a7cd0a7cf26895537d842886e2/pa/ST29091_74b34a6118e04e9e5138f0928837ef4e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Laguna 2.0 dCi Monaco GP',
 'transmission': 'manual',
 'trim': 'Monaco GP',
 'year': 2012}
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST29091%27 HTTP/1.1" 200 None
2026-03-28 11:31:07 [auto1.be] INFO: Saving data for ST29091: {'created_time': 1774697467.412167, 'last_price_update_time': 1774697467.412182, 'auction_closing_time': 1774884072.0}
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ST29091') HTTP/1.1" 204 0
2026-03-28 11:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_c2dd58f2a692d8b7833faeebb90964a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:07 [scrapy.extensions.logstats] INFO: Crawled 86 pages (at 86 pages/min), scraped 28 items (at 28 items/min)
2026-03-28 11:31:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_3a747101af4b83eadc55436757a690fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_3a747101af4b83eadc55436757a690fa.jpg not downloaded yet
2026-03-28 11:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU06988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42b87d0>
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_433a82783099dae7446393896c7cde01.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_433a82783099dae7446393896c7cde01.jpg saved to cache
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa4a4c64-279c-59a3-807e-1867f67bd6a1
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa6fcb0d0>
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_dc5be695cd8fd4bc1dcaedcf2ec5b536.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_dc5be695cd8fd4bc1dcaedcf2ec5b536.jpg saved to cache
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa4a4c64-279c-59a3-807e-1867f67bd6a1
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41a1710>
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_73434a772e733f5b7f31e5959c30c854.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_73434a772e733f5b7f31e5959c30c854.jpg saved to cache
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4348a1dc-8057-530c-a3dd-516db4e90c09
2026-03-28 11:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_8f90cfa9304f673db95dc4f7c719c848.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_7c89052a9348db0d95ff83b73664973a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_7c89052a9348db0d95ff83b73664973a.jpg not downloaded yet
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_6b9fb0d0e1be24f9bf5dc501c4af5b2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_6b9fb0d0e1be24f9bf5dc501c4af5b2b.jpg not downloaded yet
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_dbfb99a4a502014554c382ba8d41b694.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_dbfb99a4a502014554c382ba8d41b694.jpg not downloaded yet
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42c87d0>
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_26636feaf2a49ef97a46de54d149c3a0.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_26636feaf2a49ef97a46de54d149c3a0.jpg saved to cache
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4348a1dc-8057-530c-a3dd-516db4e90c09
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e8fc90>
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F88%252F1c88161aaacc8b669c5af8ea0cbd49b4%252Fpa%252FXG70738_211cb053f601c08f5a55faa0c9f7cdf6.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_211cb053f601c08f5a55faa0c9f7cdf6.jpg saved to cache
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4348a1dc-8057-530c-a3dd-516db4e90c09
2026-03-28 11:31:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4348a1dc-8057-530c-a3dd-516db4e90c09, skipping ID generation
2026-03-28 11:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4348a1dc-8057-530c-a3dd-516db4e90c09 with scrape type 1
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4348a1dc-8057-530c-a3dd-516db4e90c09 sending to next pipeline
2026-03-28 11:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4348a1dc-8057-530c-a3dd-516db4e90c09, identifier: XG70738
2026-03-28 11:31:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42e0ad0>
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F40%252F9a409c71e4f82170105723fc4699678e%252Fpa%252FKC67497_1238f5ee79344947cd64d27086f8db46.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_1238f5ee79344947cd64d27086f8db46.jpg saved to cache
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b42d776-915d-5179-afd8-c2d3d89179cf
2026-03-28 11:31:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b42d776-915d-5179-afd8-c2d3d89179cf, skipping ID generation
2026-03-28 11:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b42d776-915d-5179-afd8-c2d3d89179cf with scrape type 1
2026-03-28 11:31:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b42d776-915d-5179-afd8-c2d3d89179cf sending to next pipeline
2026-03-28 11:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0b42d776-915d-5179-afd8-c2d3d89179cf, identifier: KC67497
2026-03-28 11:31:08 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42cb510>
2026-03-28 11:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6e0103-20c0-5073-8551-c220d276f1a5/7d6e0103-20c0-5073-8551-c220d276f1a5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fe2%252F10e27f5538436904f3ff1f90cdb1d832%252Fpa%252FHR69689_c2dd58f2a692d8b7833faeebb90964a3.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_c2dd58f2a692d8b7833faeebb90964a3.jpg saved to cache
2026-03-28 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d6e0103-20c0-5073-8551-c220d276f1a5
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_b3d548af5468b18b10d66288816039dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_b3d548af5468b18b10d66288816039dc.jpg not downloaded yet
2026-03-28 11:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4348a1dc-8057-530c-a3dd-516db4e90c09 with identifier: XG70738
2026-03-28 11:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4348a1dc-8057-530c-a3dd-516db4e90c09 with identifier: XG70738
2026-03-28 11:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4348a1dc-8057-530c-a3dd-516db4e90c09 with identifier: XG70738 to the API
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_211cb053f601c08f5a55faa0c9f7cdf6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:56:43Z',
 'fuel_type': 'diesel',
 'id': '4348a1dc-8057-530c-a3dd-516db4e90c09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG70738',
 'listing': 'auction',
 'location': 'BE, Messancy',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 160095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_211cb053f601c08f5a55faa0c9f7cdf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_26636feaf2a49ef97a46de54d149c3a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_5790c3a1f65f88e7945b994b8e16c81d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_73434a772e733f5b7f31e5959c30c854.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_240509a80766a54da06ec44b37fea245.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_ed3f7f0b30f06dbed239c3cd34999879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_0509085e6137e071cb032bd90f27319c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_66718e161f74e641136230be0340a0c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_20c27bfe5316f5e6473bb3607cd3c897.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4348a1dc-8057-530c-a3dd-516db4e90c09/4348a1dc-8057-530c-a3dd-516db4e90c09_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/88/1c88161aaacc8b669c5af8ea0cbd49b4/pa/XG70738_a6741eee6d6ca1eadf833444ead3f0df.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Business Eco2',
 'transmission': 'manual',
 'trim': 'Business Eco2',
 'year': 2014}
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG70738%27 HTTP/1.1" 200 None
2026-03-28 11:31:08 [auto1.be] INFO: Saving data for XG70738: {'created_time': 1774697468.465194, 'last_price_update_time': 1774697468.465204, 'auction_closing_time': 1774886203.0}
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XG70738') HTTP/1.1" 204 0
2026-03-28 11:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0b42d776-915d-5179-afd8-c2d3d89179cf with identifier: KC67497
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 11:31:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0b42d776-915d-5179-afd8-c2d3d89179cf with identifier: KC67497
2026-03-28 11:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0b42d776-915d-5179-afd8-c2d3d89179cf with identifier: KC67497 to the API
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_1238f5ee79344947cd64d27086f8db46.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:01:08Z',
 'fuel_type': 'diesel',
 'id': '0b42d776-915d-5179-afd8-c2d3d89179cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC67497',
 'listing': 'auction',
 'location': 'BE, Wauthier-Braine',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 158713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3729665,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_1238f5ee79344947cd64d27086f8db46.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_aa6bacc5f6f940ad5d24f0ea14a8d429.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3487225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_f92e74a952a959cdf6516cd5c79cd681.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_7240ae62271b9bb74d1637470d86c23c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3347298,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_39aaeac74692bfc6b84c18e0801e0028.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_694ce225d40eb9819ed47a727a95793a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_a731adc292ba09b2308d91769c3dec5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_5d24c115dddc165c0de4f138612a4f20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_96a8c9e7db5d1199285673195bad1248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b42d776-915d-5179-afd8-c2d3d89179cf/0b42d776-915d-5179-afd8-c2d3d89179cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/40/9a409c71e4f82170105723fc4699678e/pa/KC67497_78aef8328e5b4d5e69c65a7284c7dd63.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.5 dCi N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2017}
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC67497%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Saving data for KC67497: {'created_time': 1774697469.01024, 'last_price_update_time': 1774697469.010249, 'auction_closing_time': 1774882868.0}
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KC67497') HTTP/1.1" 204 0
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_9525ec8e296120139312b167fe2885ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_9525ec8e296120139312b167fe2885ee.jpg not downloaded yet
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: GN83226
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: RD12029
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: BW40259
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW40259%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for BW40259: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: GS05656
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05656%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for GS05656: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: GG52941
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG52941%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for GG52941: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: RZ07927
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: LR81556
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: PH43501
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH43501%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for PH43501: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: YJ60712
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ60712%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for YJ60712: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: VP39360
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP39360%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for VP39360: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: LB60883
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB60883%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for LB60883: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for JX04101: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: UJ84188
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: CP28232
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP28232%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for CP28232: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: DK34546
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK34546%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for DK34546: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: UZ89311
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ89311%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for UZ89311: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: PW65130
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW65130%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for PW65130: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: TW50978
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: ZM60414
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM60414%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for ZM60414: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: GE86423
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: BJ47720
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ47720%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for BJ47720: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for LM00165: 2
2026-03-28 11:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37e3efae-4532-58c6-ba1b-50ca73956c18 with identifier: LM00165
2026-03-28 11:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37e3efae-4532-58c6-ba1b-50ca73956c18 with scrape type 2
2026-03-28 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37e3efae-4532-58c6-ba1b-50ca73956c18 with scrape type 2
2026-03-28 11:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 37e3efae-4532-58c6-ba1b-50ca73956c18, identifier: LM00165
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_8aad9ebcf1eb3862e74b672b96058c50.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_8aad9ebcf1eb3862e74b672b96058c50.jpg not downloaded yet
2026-03-28 11:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 37e3efae-4532-58c6-ba1b-50ca73956c18 with identifier: LM00165
2026-03-28 11:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 37e3efae-4532-58c6-ba1b-50ca73956c18 with identifier: LM00165
2026-03-28 11:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 37e3efae-4532-58c6-ba1b-50ca73956c18 with identifier: LM00165 to the API
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:09:54Z',
 'fuel_type': 'petrol',
 'id': '37e3efae-4532-58c6-ba1b-50ca73956c18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM00165',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 47258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seller_name': None,
 'title': 'BMW 2er 218i Gran Coupe M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2022}
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Saving data for LM00165: {'auction_closing_time': 1774714194.0, 'created_time': 1774092739.150304, 'last_price_update_time': 1774697469.753348}
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM00165') HTTP/1.1" 204 0
2026-03-28 11:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42d6110>
2026-03-28 11:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_8f90cfa9304f673db95dc4f7c719c848.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_8f90cfa9304f673db95dc4f7c719c848.jpg saved to cache
2026-03-28 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9970f351-8e7b-5b05-806e-ef9f53ff2274
2026-03-28 11:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_6bdbc3cc57935dcc27646984f058764a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_504dad2e475ea5e73ebd8209034e1cd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_504dad2e475ea5e73ebd8209034e1cd5.jpg not downloaded yet
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: AE10158
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: PW03008
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: DJ92015
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: RM94904
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: ML32022
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: YC12895
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: DF46667
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: YC93311
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC93311%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for YC93311: 0
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: GW94232
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: TD21641
2026-03-28 11:31:09 [auto1.be] INFO: Found listing with ID: BX24259
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX24259%27 HTTP/1.1" 200 None
2026-03-28 11:31:09 [auto1.be] INFO: Scrape type for BX24259: 0
2026-03-28 11:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_63c21528a7d4cb729b0d32e0ec227b2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_ec4df0696d9e08aa14238d688345398d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_1a259e49ea504416c3143f15fbad57aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_1a259e49ea504416c3143f15fbad57aa.jpg not downloaded yet
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_38b0a405160b994577546fce29670e82.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_38b0a405160b994577546fce29670e82.jpg not downloaded yet
2026-03-28 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_aa5c194adf6328d676de223e1d911188.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_1e0386e720ad95f7e415fd4f36854275.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_1e0386e720ad95f7e415fd4f36854275.jpg not downloaded yet
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4cbe9d0>
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842db12f-e1ec-585c-a241-9fbc250f20de/842db12f-e1ec-585c-a241-9fbc250f20de_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F84%252F5f8472e245ec27f2e6b58f94b41fb3e0%252Fpa%252FGN32494_6bdbc3cc57935dcc27646984f058764a.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_6bdbc3cc57935dcc27646984f058764a.jpg saved to cache
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 842db12f-e1ec-585c-a241-9fbc250f20de
2026-03-28 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_91a9251a4669826f85c54ed7eb96b7a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_c714de09f77efc59af647411d5975daa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_5f45c90d5ec50bea2847bbdd0b2034f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_5f45c90d5ec50bea2847bbdd0b2034f5.jpg not downloaded yet
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_a7de989d861e715202aca30142cede22.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_a7de989d861e715202aca30142cede22.jpg not downloaded yet
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa40fa9d0>
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842db12f-e1ec-585c-a241-9fbc250f20de/842db12f-e1ec-585c-a241-9fbc250f20de_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F84%252F5f8472e245ec27f2e6b58f94b41fb3e0%252Fpa%252FGN32494_63c21528a7d4cb729b0d32e0ec227b2a.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_63c21528a7d4cb729b0d32e0ec227b2a.jpg saved to cache
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 842db12f-e1ec-585c-a241-9fbc250f20de
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa429ba50>
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_ec4df0696d9e08aa14238d688345398d.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_ec4df0696d9e08aa14238d688345398d.jpg saved to cache
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e
2026-03-28 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_8a79e476dcbcc1620ad178be9dedaaf6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_fb7786df59c569b86b70f477982444f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_355677133beedc8bd9d42bd4ede9dcd8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4ce5710>
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_aa5c194adf6328d676de223e1d911188.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_aa5c194adf6328d676de223e1d911188.jpg saved to cache
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75
2026-03-28 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_ed13cb79716cf6439ba86b69e93d3b8e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e58810>
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_91a9251a4669826f85c54ed7eb96b7a5.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_91a9251a4669826f85c54ed7eb96b7a5.jpg saved to cache
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4349810>
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842db12f-e1ec-585c-a241-9fbc250f20de/842db12f-e1ec-585c-a241-9fbc250f20de_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F84%252F5f8472e245ec27f2e6b58f94b41fb3e0%252Fpa%252FGN32494_c714de09f77efc59af647411d5975daa.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_c714de09f77efc59af647411d5975daa.jpg saved to cache
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 842db12f-e1ec-585c-a241-9fbc250f20de
2026-03-28 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_9525ec8e296120139312b167fe2885ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_38d034b1e18a01e17551d1e5f416dd5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_8aad9ebcf1eb3862e74b672b96058c50.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa44a6690>
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5d%252F335df878ca28a77ccabb6e6ff2379669%252Fpa%252FFC31614_8a79e476dcbcc1620ad178be9dedaaf6.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_8a79e476dcbcc1620ad178be9dedaaf6.jpg saved to cache
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c308775-4db8-55d1-af91-dc9daebcc7bf
2026-03-28 11:31:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c308775-4db8-55d1-af91-dc9daebcc7bf, skipping ID generation
2026-03-28 11:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c308775-4db8-55d1-af91-dc9daebcc7bf with scrape type 1
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c308775-4db8-55d1-af91-dc9daebcc7bf sending to next pipeline
2026-03-28 11:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5c308775-4db8-55d1-af91-dc9daebcc7bf, identifier: FC31614
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41f2390>
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_fb7786df59c569b86b70f477982444f4.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_fb7786df59c569b86b70f477982444f4.jpg saved to cache
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa429bc50>
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842db12f-e1ec-585c-a241-9fbc250f20de/842db12f-e1ec-585c-a241-9fbc250f20de_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F84%252F5f8472e245ec27f2e6b58f94b41fb3e0%252Fpa%252FGN32494_355677133beedc8bd9d42bd4ede9dcd8.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_355677133beedc8bd9d42bd4ede9dcd8.jpg saved to cache
2026-03-28 11:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 842db12f-e1ec-585c-a241-9fbc250f20de
2026-03-28 11:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5c308775-4db8-55d1-af91-dc9daebcc7bf with identifier: FC31614
2026-03-28 11:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5c308775-4db8-55d1-af91-dc9daebcc7bf with identifier: FC31614
2026-03-28 11:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5c308775-4db8-55d1-af91-dc9daebcc7bf with identifier: FC31614 to the API
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_8a79e476dcbcc1620ad178be9dedaaf6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:38:38Z',
 'fuel_type': 'petrol',
 'id': '5c308775-4db8-55d1-af91-dc9daebcc7bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC31614',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 44615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3677042,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_8a79e476dcbcc1620ad178be9dedaaf6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_1a565def4e55d7bb8a0be79b522d7ff1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_3811d0a2d0500dde47a8a25dc455601a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3059593,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_7113cab526fe7e24d966013b1bca0487.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_95b8b71c8f0b5352d3d4aefb2a56b7cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_5313836615149d50c68f4e24394ee0af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2982283,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_d31f0722224d8588fc21578fb158d280.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_3ec16a9758e2e2fe366016cbfc1329be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_ff06bf40baea1f1f963f6c87f328389f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c308775-4db8-55d1-af91-dc9daebcc7bf/5c308775-4db8-55d1-af91-dc9daebcc7bf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/5d/335df878ca28a77ccabb6e6ff2379669/pa/FC31614_ccd3d6ff9d14aba62e347225bb819856.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna +',
 'transmission': 'automatic',
 'trim': 'Tekna +',
 'year': 2017}
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC31614%27 HTTP/1.1" 200 None
2026-03-28 11:31:11 [auto1.be] INFO: Saving data for FC31614: {'created_time': 1774697471.096106, 'last_price_update_time': 1774697471.096117, 'auction_closing_time': 1774885118.0}
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC31614') HTTP/1.1" 204 0
2026-03-28 11:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_b3d548af5468b18b10d66288816039dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_1e0386e720ad95f7e415fd4f36854275.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_38b0a405160b994577546fce29670e82.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4478a10>
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842db12f-e1ec-585c-a241-9fbc250f20de/842db12f-e1ec-585c-a241-9fbc250f20de_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F84%252F5f8472e245ec27f2e6b58f94b41fb3e0%252Fpa%252FGN32494_ed13cb79716cf6439ba86b69e93d3b8e.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_ed13cb79716cf6439ba86b69e93d3b8e.jpg saved to cache
2026-03-28 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 842db12f-e1ec-585c-a241-9fbc250f20de
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4cbc7d0>
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_9525ec8e296120139312b167fe2885ee.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_9525ec8e296120139312b167fe2885ee.jpg saved to cache
2026-03-28 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa445c410>
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_842db12f-e1ec-585c-a241-9fbc250f20de/842db12f-e1ec-585c-a241-9fbc250f20de_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F84%252F5f8472e245ec27f2e6b58f94b41fb3e0%252Fpa%252FGN32494_38d034b1e18a01e17551d1e5f416dd5e.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_38d034b1e18a01e17551d1e5f416dd5e.jpg saved to cache
2026-03-28 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 842db12f-e1ec-585c-a241-9fbc250f20de
2026-03-28 11:31:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 842db12f-e1ec-585c-a241-9fbc250f20de, skipping ID generation
2026-03-28 11:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 842db12f-e1ec-585c-a241-9fbc250f20de with scrape type 1
2026-03-28 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 842db12f-e1ec-585c-a241-9fbc250f20de sending to next pipeline
2026-03-28 11:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 842db12f-e1ec-585c-a241-9fbc250f20de, identifier: GN32494
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4cf6510>
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_8aad9ebcf1eb3862e74b672b96058c50.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_8aad9ebcf1eb3862e74b672b96058c50.jpg saved to cache
2026-03-28 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e
2026-03-28 11:31:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 842db12f-e1ec-585c-a241-9fbc250f20de with identifier: GN32494
2026-03-28 11:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 842db12f-e1ec-585c-a241-9fbc250f20de with identifier: GN32494
2026-03-28 11:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 842db12f-e1ec-585c-a241-9fbc250f20de with identifier: GN32494 to the API
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_38d034b1e18a01e17551d1e5f416dd5e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:29:17Z',
 'fuel_type': 'diesel',
 'id': '842db12f-e1ec-585c-a241-9fbc250f20de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN32494',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 241084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842db12f-e1ec-585c-a241-9fbc250f20de/842db12f-e1ec-585c-a241-9fbc250f20de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_38d034b1e18a01e17551d1e5f416dd5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842db12f-e1ec-585c-a241-9fbc250f20de/842db12f-e1ec-585c-a241-9fbc250f20de_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_ed13cb79716cf6439ba86b69e93d3b8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842db12f-e1ec-585c-a241-9fbc250f20de/842db12f-e1ec-585c-a241-9fbc250f20de_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_355677133beedc8bd9d42bd4ede9dcd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842db12f-e1ec-585c-a241-9fbc250f20de/842db12f-e1ec-585c-a241-9fbc250f20de_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_c714de09f77efc59af647411d5975daa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842db12f-e1ec-585c-a241-9fbc250f20de/842db12f-e1ec-585c-a241-9fbc250f20de_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_63c21528a7d4cb729b0d32e0ec227b2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842db12f-e1ec-585c-a241-9fbc250f20de/842db12f-e1ec-585c-a241-9fbc250f20de_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/84/5f8472e245ec27f2e6b58f94b41fb3e0/pa/GN32494_6bdbc3cc57935dcc27646984f058764a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN32494%27 HTTP/1.1" 200 None
2026-03-28 11:31:11 [auto1.be] INFO: Saving data for GN32494: {'created_time': 1774697471.88244, 'last_price_update_time': 1774697471.882452, 'auction_closing_time': 1774884557.0}
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GN32494') HTTP/1.1" 204 0
2026-03-28 11:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_a7de989d861e715202aca30142cede22.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_5f45c90d5ec50bea2847bbdd0b2034f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_1a259e49ea504416c3143f15fbad57aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa433a010>
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_b3d548af5468b18b10d66288816039dc.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_b3d548af5468b18b10d66288816039dc.jpg saved to cache
2026-03-28 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4cf4dd0>
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_1e0386e720ad95f7e415fd4f36854275.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_1e0386e720ad95f7e415fd4f36854275.jpg saved to cache
2026-03-28 11:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41a9b10>
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_38b0a405160b994577546fce29670e82.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_38b0a405160b994577546fce29670e82.jpg saved to cache
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e
2026-03-28 11:31:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_7fe758ec9bdd96de1513534ea8025332.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e59810>
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_a7de989d861e715202aca30142cede22.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_a7de989d861e715202aca30142cede22.jpg saved to cache
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4121350>
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_5f45c90d5ec50bea2847bbdd0b2034f5.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_5f45c90d5ec50bea2847bbdd0b2034f5.jpg saved to cache
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4266f90>
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_1a259e49ea504416c3143f15fbad57aa.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_1a259e49ea504416c3143f15fbad57aa.jpg saved to cache
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e
2026-03-28 11:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_504dad2e475ea5e73ebd8209034e1cd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_6b9fb0d0e1be24f9bf5dc501c4af5b2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_dbfb99a4a502014554c382ba8d41b694.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa434a650>
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F3b%252F973baa4a602949012dcd73ea55465c79%252Fpa%252FAV16828_7fe758ec9bdd96de1513534ea8025332.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_7fe758ec9bdd96de1513534ea8025332.jpg saved to cache
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa4a4c64-279c-59a3-807e-1867f67bd6a1
2026-03-28 11:31:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa4a4c64-279c-59a3-807e-1867f67bd6a1, skipping ID generation
2026-03-28 11:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa4a4c64-279c-59a3-807e-1867f67bd6a1 with scrape type 1
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa4a4c64-279c-59a3-807e-1867f67bd6a1 sending to next pipeline
2026-03-28 11:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aa4a4c64-279c-59a3-807e-1867f67bd6a1, identifier: AV16828
2026-03-28 11:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aa4a4c64-279c-59a3-807e-1867f67bd6a1 with identifier: AV16828
2026-03-28 11:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aa4a4c64-279c-59a3-807e-1867f67bd6a1 with identifier: AV16828
2026-03-28 11:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aa4a4c64-279c-59a3-807e-1867f67bd6a1 with identifier: AV16828 to the API
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_7fe758ec9bdd96de1513534ea8025332.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:21:55Z',
 'fuel_type': 'petrol',
 'id': 'aa4a4c64-279c-59a3-807e-1867f67bd6a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV16828',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'BMW',
 'model': '3er',
 'odometer': 155922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_dc7e563d33d04227f8dc16418dd9da40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_b59ba82f8ff143c839937fbb0cfa03e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_315d7bd771c87ac3a0087adf82598f5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_aefd21541d1ae4fd807558516fc93648.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_dc5be695cd8fd4bc1dcaedcf2ec5b536.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3056119,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_7fe758ec9bdd96de1513534ea8025332.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_167e8aea1731feeb7db9ae1cb129facf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_3c3d6d13fcc8536cf80ba2dd04f6ce4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_618b16afa282dff25e17a08fca2fd07a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a4c64-279c-59a3-807e-1867f67bd6a1/aa4a4c64-279c-59a3-807e-1867f67bd6a1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/3b/973baa4a602949012dcd73ea55465c79/pa/AV16828_433a82783099dae7446393896c7cde01.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 328i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV16828%27 HTTP/1.1" 200 None
2026-03-28 11:31:12 [auto1.be] INFO: Saving data for AV16828: {'created_time': 1774697472.742866, 'last_price_update_time': 1774697472.742877, 'auction_closing_time': 1774884115.0}
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AV16828') HTTP/1.1" 204 0
2026-03-28 11:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_7c89052a9348db0d95ff83b73664973a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_c78124d96a5b8ac1c4df0b6f64e5292b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_c3abadbc83fdb1ffac240bb1fc6e259a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_d53019cebae7b1a94b2d61d53e31d871.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV83163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4264f10>
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_504dad2e475ea5e73ebd8209034e1cd5.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_504dad2e475ea5e73ebd8209034e1cd5.jpg saved to cache
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4241b50>
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_6b9fb0d0e1be24f9bf5dc501c4af5b2b.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_6b9fb0d0e1be24f9bf5dc501c4af5b2b.jpg saved to cache
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa434a610>
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_dbfb99a4a502014554c382ba8d41b694.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_dbfb99a4a502014554c382ba8d41b694.jpg saved to cache
2026-03-28 11:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75
2026-03-28 11:31:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_3a747101af4b83eadc55436757a690fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU06988> (referer: https://www.auto1.com/v1/car-details-view/CU06988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4241b90>
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_7c89052a9348db0d95ff83b73664973a.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_7c89052a9348db0d95ff83b73664973a.jpg saved to cache
2026-03-28 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75
2026-03-28 11:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa429aa90>
2026-03-28 11:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d6e0103-20c0-5073-8551-c220d276f1a5/7d6e0103-20c0-5073-8551-c220d276f1a5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fe2%252F10e27f5538436904f3ff1f90cdb1d832%252Fpa%252FHR69689_c78124d96a5b8ac1c4df0b6f64e5292b.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_c78124d96a5b8ac1c4df0b6f64e5292b.jpg saved to cache
2026-03-28 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d6e0103-20c0-5073-8551-c220d276f1a5
2026-03-28 11:31:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d6e0103-20c0-5073-8551-c220d276f1a5, skipping ID generation
2026-03-28 11:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d6e0103-20c0-5073-8551-c220d276f1a5 with scrape type 1
2026-03-28 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d6e0103-20c0-5073-8551-c220d276f1a5 sending to next pipeline
2026-03-28 11:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7d6e0103-20c0-5073-8551-c220d276f1a5, identifier: HR69689
2026-03-28 11:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa73aab90>
2026-03-28 11:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_c3abadbc83fdb1ffac240bb1fc6e259a.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_c3abadbc83fdb1ffac240bb1fc6e259a.jpg saved to cache
2026-03-28 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115
2026-03-28 11:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa417b890>
2026-03-28 11:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_d53019cebae7b1a94b2d61d53e31d871.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_d53019cebae7b1a94b2d61d53e31d871.jpg saved to cache
2026-03-28 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249
2026-03-28 11:31:13 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_3b292a3cad8c78ddd97dea9fcb894d0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7d6e0103-20c0-5073-8551-c220d276f1a5 with identifier: HR69689
2026-03-28 11:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7d6e0103-20c0-5073-8551-c220d276f1a5 with identifier: HR69689
2026-03-28 11:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7d6e0103-20c0-5073-8551-c220d276f1a5 with identifier: HR69689 to the API
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_c78124d96a5b8ac1c4df0b6f64e5292b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:09:55Z',
 'fuel_type': 'petrol',
 'id': '7d6e0103-20c0-5073-8551-c220d276f1a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR69689',
 'listing': 'auction',
 'location': 'BE, Oostakker',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 79043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d6e0103-20c0-5073-8551-c220d276f1a5/7d6e0103-20c0-5073-8551-c220d276f1a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_b42595d08f5cec511c959fd2a31a14fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d6e0103-20c0-5073-8551-c220d276f1a5/7d6e0103-20c0-5073-8551-c220d276f1a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_5fceb675a1ed9cc207737df3e4d2a0cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d6e0103-20c0-5073-8551-c220d276f1a5/7d6e0103-20c0-5073-8551-c220d276f1a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_84df0d3bd1ff164a1add797e576ac03b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d6e0103-20c0-5073-8551-c220d276f1a5/7d6e0103-20c0-5073-8551-c220d276f1a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_8f8faeb0504e97ad780a4dbbccdb6e1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d6e0103-20c0-5073-8551-c220d276f1a5/7d6e0103-20c0-5073-8551-c220d276f1a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_c78124d96a5b8ac1c4df0b6f64e5292b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d6e0103-20c0-5073-8551-c220d276f1a5/7d6e0103-20c0-5073-8551-c220d276f1a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/e2/10e27f5538436904f3ff1f90cdb1d832/pa/HR69689_c2dd58f2a692d8b7833faeebb90964a3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.1 Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2010}
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR69689%27 HTTP/1.1" 200 None
2026-03-28 11:31:13 [auto1.be] INFO: Saving data for HR69689: {'created_time': 1774697473.760001, 'last_price_update_time': 1774697473.760013, 'auction_closing_time': 1774883395.0}
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HR69689') HTTP/1.1" 204 0
2026-03-28 11:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_251d2915de4cbba57cf7630a3d3fcd24.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: LB55394
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: MN64395
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN64395%27 HTTP/1.1" 200 None
2026-03-28 11:31:13 [auto1.be] INFO: Scrape type for MN64395: 0
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: AX27110
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: GB85934
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-28 11:31:13 [auto1.be] INFO: Scrape type for CM40127: 0
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-28 11:31:13 [auto1.be] INFO: Scrape type for YH98972: 0
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: YX66002
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX66002%27 HTTP/1.1" 200 None
2026-03-28 11:31:13 [auto1.be] INFO: Scrape type for YX66002: 0
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: PR37992
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-28 11:31:13 [auto1.be] INFO: Scrape type for MC94265: 0
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: HL89741
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-28 11:31:13 [auto1.be] INFO: Scrape type for BA13225: 0
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: ER13199
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: FM74317
2026-03-28 11:31:13 [auto1.be] INFO: Found listing with ID: FT07874
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT07874%27 HTTP/1.1" 200 None
2026-03-28 11:31:13 [auto1.be] INFO: Scrape type for FT07874: 2
2026-03-28 11:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88bc5f2a-615f-5f51-af4b-344bbe2254a2 with identifier: FT07874
2026-03-28 11:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88bc5f2a-615f-5f51-af4b-344bbe2254a2 with scrape type 2
2026-03-28 11:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88bc5f2a-615f-5f51-af4b-344bbe2254a2 with scrape type 2
2026-03-28 11:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 88bc5f2a-615f-5f51-af4b-344bbe2254a2, identifier: FT07874
2026-03-28 11:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_9832c62e4996af7f4a7e59d1336a3b62.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_62e9fc4e76874f0a7a3d7e98fb5312f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 88bc5f2a-615f-5f51-af4b-344bbe2254a2 with identifier: FT07874
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 11:31:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 88bc5f2a-615f-5f51-af4b-344bbe2254a2 with identifier: FT07874
2026-03-28 11:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 88bc5f2a-615f-5f51-af4b-344bbe2254a2 with identifier: FT07874 to the API
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:37:26Z',
 'fuel_type': 'petrol',
 'id': '88bc5f2a-615f-5f51-af4b-344bbe2254a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT07874',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 25990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-30',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT07874%27 HTTP/1.1" 200 None
2026-03-28 11:31:14 [auto1.be] INFO: Saving data for FT07874: {'auction_closing_time': 1774715846.0, 'created_time': 1774513855.894459, 'last_price_update_time': 1774697474.478751}
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FT07874') HTTP/1.1" 204 0
2026-03-28 11:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_6fa77fdd6a977bd95185631b73a47e19.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-28 11:31:14 [auto1.be] INFO: Scrape type for UN77217: 0
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: PZ75244
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ75244%27 HTTP/1.1" 200 None
2026-03-28 11:31:14 [auto1.be] INFO: Scrape type for PZ75244: 0
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-28 11:31:14 [auto1.be] INFO: Scrape type for AJ68637: 0
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: UL09185
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL09185%27 HTTP/1.1" 200 None
2026-03-28 11:31:14 [auto1.be] INFO: Scrape type for UL09185: 0
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: CE16850
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE16850%27 HTTP/1.1" 200 None
2026-03-28 11:31:14 [auto1.be] INFO: Scrape type for CE16850: 0
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: YN70818
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: WR10172
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: DZ60295
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: GW87029
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: YL95058
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: GV15800
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV15800%27 HTTP/1.1" 200 None
2026-03-28 11:31:14 [auto1.be] INFO: Scrape type for GV15800: 0
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: BY14138
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: EF17884
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-28 11:31:14 [auto1.be] INFO: Scrape type for FY43318: 0
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: BC09650
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC09650%27 HTTP/1.1" 200 None
2026-03-28 11:31:14 [auto1.be] INFO: Scrape type for BC09650: 0
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: CN66713
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: EJ63633
2026-03-28 11:31:14 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-28 11:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV92885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4ce4f90>
2026-03-28 11:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1e%252Faf1e2e2c5854fbd5d3406c80692fd96a%252Fpa%252FKH04328_3a747101af4b83eadc55436757a690fa.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_3a747101af4b83eadc55436757a690fa.jpg saved to cache
2026-03-28 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e
2026-03-28 11:31:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b05f4bf-3759-5498-b72a-8efaf507fc8e, skipping ID generation
2026-03-28 11:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e with scrape type 1
2026-03-28 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e sending to next pipeline
2026-03-28 11:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2b05f4bf-3759-5498-b72a-8efaf507fc8e, identifier: KH04328
2026-03-28 11:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d8a5f1d-43b3-505c-80cd-d892bccfe986 with identifier: CU06988
2026-03-28 11:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986 with scrape type 1
2026-03-28 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_3440b8c34555cddfcaac919bb307c2d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_3440b8c34555cddfcaac919bb307c2d9.jpg not downloaded yet
2026-03-28 11:31:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4234e10>
2026-03-28 11:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_3b292a3cad8c78ddd97dea9fcb894d0a.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_3b292a3cad8c78ddd97dea9fcb894d0a.jpg saved to cache
2026-03-28 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa424d490>
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_251d2915de4cbba57cf7630a3d3fcd24.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_251d2915de4cbba57cf7630a3d3fcd24.jpg saved to cache
2026-03-28 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9970f351-8e7b-5b05-806e-ef9f53ff2274
2026-03-28 11:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_716082c9f19f98f09cd012ca28a256d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2b05f4bf-3759-5498-b72a-8efaf507fc8e with identifier: KH04328
2026-03-28 11:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2b05f4bf-3759-5498-b72a-8efaf507fc8e with identifier: KH04328
2026-03-28 11:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2b05f4bf-3759-5498-b72a-8efaf507fc8e with identifier: KH04328 to the API
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_3a747101af4b83eadc55436757a690fa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:27:16Z',
 'fuel_type': 'diesel',
 'id': '2b05f4bf-3759-5498-b72a-8efaf507fc8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH04328',
 'listing': 'auction',
 'location': 'BE, Mechelen',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 220423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_ec4df0696d9e08aa14238d688345398d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2804285,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_3a747101af4b83eadc55436757a690fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_6b9fb0d0e1be24f9bf5dc501c4af5b2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_b3d548af5468b18b10d66288816039dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_8aad9ebcf1eb3862e74b672b96058c50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_1a259e49ea504416c3143f15fbad57aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_38b0a405160b994577546fce29670e82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_1e0386e720ad95f7e415fd4f36854275.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_5f45c90d5ec50bea2847bbdd0b2034f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b05f4bf-3759-5498-b72a-8efaf507fc8e/2b05f4bf-3759-5498-b72a-8efaf507fc8e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1e/af1e2e2c5854fbd5d3406c80692fd96a/pa/KH04328_a7de989d861e715202aca30142cede22.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2013}
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH04328%27 HTTP/1.1" 200 None
2026-03-28 11:31:15 [auto1.be] INFO: Saving data for KH04328: {'created_time': 1774697475.504987, 'last_price_update_time': 1774697475.504997, 'auction_closing_time': 1774884436.0}
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KH04328') HTTP/1.1" 204 0
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_8e431d64b1f9b1dba4d7fd143ee2ca36.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_8e431d64b1f9b1dba4d7fd143ee2ca36.jpg not downloaded yet
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4380950>
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_9832c62e4996af7f4a7e59d1336a3b62.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_9832c62e4996af7f4a7e59d1336a3b62.jpg saved to cache
2026-03-28 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa418b1d0>
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F51%252Fe451a82e23ae465be7b5757102fb372c%252Fpa%252FKX73156_62e9fc4e76874f0a7a3d7e98fb5312f4.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_62e9fc4e76874f0a7a3d7e98fb5312f4.jpg saved to cache
2026-03-28 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249
2026-03-28 11:31:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d4b38b4-c5ac-582c-8269-3dfe1108d249, skipping ID generation
2026-03-28 11:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249 with scrape type 1
2026-03-28 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249 sending to next pipeline
2026-03-28 11:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2d4b38b4-c5ac-582c-8269-3dfe1108d249, identifier: KX73156
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4433890>
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_6fa77fdd6a977bd95185631b73a47e19.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_6fa77fdd6a977bd95185631b73a47e19.jpg saved to cache
2026-03-28 11:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7851fcd-848f-552e-bb27-09862abc5ccc
2026-03-28 11:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_43aa5f5f360be0962583a88553054dc5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2d4b38b4-c5ac-582c-8269-3dfe1108d249 with identifier: KX73156
2026-03-28 11:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2d4b38b4-c5ac-582c-8269-3dfe1108d249 with identifier: KX73156
2026-03-28 11:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2d4b38b4-c5ac-582c-8269-3dfe1108d249 with identifier: KX73156 to the API
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_62e9fc4e76874f0a7a3d7e98fb5312f4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 205,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:30Z',
 'fuel_type': 'diesel',
 'id': '2d4b38b4-c5ac-582c-8269-3dfe1108d249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX73156',
 'listing': 'auction',
 'location': 'BE, Kapellen',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 70999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3350544,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_d88a48376440da4bd0bd7e8379c82623.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_62e9fc4e76874f0a7a3d7e98fb5312f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_d53019cebae7b1a94b2d61d53e31d871.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_d8d182eebade873b58a5c4feaec2bd78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_a18b87be1358e2910eb3c4d0c2f6fd37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2920023,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_f6a57058e3f670f52af02c50222d92a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_9df3176604e00e59cd5be6d772c175b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_5f90435ca49f3387118f7eeb8e44b867.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_9e1d224d08aaac8989eb4192251b4d4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4b38b4-c5ac-582c-8269-3dfe1108d249/2d4b38b4-c5ac-582c-8269-3dfe1108d249_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/51/e451a82e23ae465be7b5757102fb372c/pa/KX73156_771fd1472fa9bc0b52287ecac45c1877.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2019}
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX73156%27 HTTP/1.1" 200 None
2026-03-28 11:31:16 [auto1.be] INFO: Saving data for KX73156: {'created_time': 1774697476.263605, 'last_price_update_time': 1774697476.263616, 'auction_closing_time': 1774882950.0}
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KX73156') HTTP/1.1" 204 0
2026-03-28 11:31:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_8978ade251299e6fc295b4288a7de59e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_8978ade251299e6fc295b4288a7de59e.jpg not downloaded yet
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa70f15d0>
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_716082c9f19f98f09cd012ca28a256d1.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_716082c9f19f98f09cd012ca28a256d1.jpg saved to cache
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7851fcd-848f-552e-bb27-09862abc5ccc
2026-03-28 11:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_d875dd0187ed86c616f62642b9e752b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_b7034930ce5b95529b5709ec0303783c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_b7034930ce5b95529b5709ec0303783c.jpg not downloaded yet
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa6fca650>
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_43aa5f5f360be0962583a88553054dc5.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_43aa5f5f360be0962583a88553054dc5.jpg saved to cache
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115
2026-03-28 11:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_94d6b3b2f465168f902d3a25f917aa28.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_644916e489ce5f9d165138126ff7927d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_644916e489ce5f9d165138126ff7927d.jpg not downloaded yet
2026-03-28 11:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_3440b8c34555cddfcaac919bb307c2d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_85be11409bd8bfae2abd1d59b2e19845.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_85be11409bd8bfae2abd1d59b2e19845.jpg not downloaded yet
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_1911948a96b189e3beb81016d855cdf6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_1911948a96b189e3beb81016d855cdf6.jpg not downloaded yet
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_7a47340c06d0f4154534bbc480eb6c4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_7a47340c06d0f4154534bbc480eb6c4d.jpg not downloaded yet
2026-03-28 11:31:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa40f9490>
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_d875dd0187ed86c616f62642b9e752b4.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_d875dd0187ed86c616f62642b9e752b4.jpg saved to cache
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9970f351-8e7b-5b05-806e-ef9f53ff2274
2026-03-28 11:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_0122620d2db4cab22636bb770295506c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_c06e26107cd6334903bbed80b243ffc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_c06e26107cd6334903bbed80b243ffc2.jpg not downloaded yet
2026-03-28 11:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_f0badfa7c2b95698f849e3b8fb7c6a74.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e4ea10>
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_94d6b3b2f465168f902d3a25f917aa28.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_94d6b3b2f465168f902d3a25f917aa28.jpg saved to cache
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75
2026-03-28 11:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_d1bd990bd7f6d583aabdbcde443db120.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_22aee8eb91816a9ebb25c57e16e0e81b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_22aee8eb91816a9ebb25c57e16e0e81b.jpg not downloaded yet
2026-03-28 11:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_8e431d64b1f9b1dba4d7fd143ee2ca36.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4421f10>
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_3440b8c34555cddfcaac919bb307c2d9.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_3440b8c34555cddfcaac919bb307c2d9.jpg saved to cache
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4128390>
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1acef5-aad0-5707-b995-cc1bd85f4d16/3f1acef5-aad0-5707-b995-cc1bd85f4d16_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F07%252F57075965bc2f5d3f86849fd03808fad4%252Fpa%252FVX51166_0122620d2db4cab22636bb770295506c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_0122620d2db4cab22636bb770295506c.jpg saved to cache
2026-03-28 11:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f1acef5-aad0-5707-b995-cc1bd85f4d16
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4439710>
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8f9d8e-56d3-501a-a3bf-fd247e39458e/9b8f9d8e-56d3-501a-a3bf-fd247e39458e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F08%252Fe008542458bd80f5449a17a31e3862fc%252Fpa%252FUR02836_f0badfa7c2b95698f849e3b8fb7c6a74.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_f0badfa7c2b95698f849e3b8fb7c6a74.jpg saved to cache
2026-03-28 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b8f9d8e-56d3-501a-a3bf-fd247e39458e
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_644916e489ce5f9d165138126ff7927d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_7a47340c06d0f4154534bbc480eb6c4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU94491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4277310>
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_d1bd990bd7f6d583aabdbcde443db120.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_d1bd990bd7f6d583aabdbcde443db120.jpg saved to cache
2026-03-28 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef856ef4-db6c-5637-9d07-afdae111ee37
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa432dc10>
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_8e431d64b1f9b1dba4d7fd143ee2ca36.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_8e431d64b1f9b1dba4d7fd143ee2ca36.jpg saved to cache
2026-03-28 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_eb6e7432ea18b8d1497d912744ca2c9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_6426412e6605fca3d57438d129f3d7c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa446ed10>
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_644916e489ce5f9d165138126ff7927d.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_644916e489ce5f9d165138126ff7927d.jpg saved to cache
2026-03-28 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU93740/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa40f9550>
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_7a47340c06d0f4154534bbc480eb6c4d.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_7a47340c06d0f4154534bbc480eb6c4d.jpg saved to cache
2026-03-28 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_1911948a96b189e3beb81016d855cdf6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_2bc7d872e2eba48e825ba1f95e48765c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_7e07c67c2b7423c02f319900e30fca66.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4241b10>
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F07%252Fed077446595967dacd4efc1bfa98d2dd%252Fpa%252FTV57254_eb6e7432ea18b8d1497d912744ca2c9c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_eb6e7432ea18b8d1497d912744ca2c9c.jpg saved to cache
2026-03-28 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75
2026-03-28 11:31:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c34719b-6f0b-5dce-9c50-d8ca13e51f75, skipping ID generation
2026-03-28 11:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75 with scrape type 1
2026-03-28 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75 sending to next pipeline
2026-03-28 11:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c34719b-6f0b-5dce-9c50-d8ca13e51f75, identifier: TV57254
2026-03-28 11:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c34719b-6f0b-5dce-9c50-d8ca13e51f75 with identifier: TV57254
2026-03-28 11:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c34719b-6f0b-5dce-9c50-d8ca13e51f75 with identifier: TV57254
2026-03-28 11:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c34719b-6f0b-5dce-9c50-d8ca13e51f75 with identifier: TV57254 to the API
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_eb6e7432ea18b8d1497d912744ca2c9c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:56:57Z',
 'fuel_type': 'diesel',
 'id': '1c34719b-6f0b-5dce-9c50-d8ca13e51f75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV57254',
 'listing': 'auction',
 'location': 'BE, Mechelen',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 141137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2750189,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_eb6e7432ea18b8d1497d912744ca2c9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576457,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_94d6b3b2f465168f902d3a25f917aa28.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_fb7786df59c569b86b70f477982444f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_91a9251a4669826f85c54ed7eb96b7a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_aa5c194adf6328d676de223e1d911188.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2910825,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_3b292a3cad8c78ddd97dea9fcb894d0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2499048,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_7c89052a9348db0d95ff83b73664973a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_dbfb99a4a502014554c382ba8d41b694.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_9525ec8e296120139312b167fe2885ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c34719b-6f0b-5dce-9c50-d8ca13e51f75/1c34719b-6f0b-5dce-9c50-d8ca13e51f75_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/07/ed077446595967dacd4efc1bfa98d2dd/pa/TV57254_504dad2e475ea5e73ebd8209034e1cd5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style Copa',
 'transmission': 'manual',
 'trim': 'Style Copa',
 'year': 2012}
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV57254%27 HTTP/1.1" 200 None
2026-03-28 11:31:17 [auto1.be] INFO: Saving data for TV57254: {'created_time': 1774697477.885361, 'last_price_update_time': 1774697477.885371, 'auction_closing_time': 1774886217.0}
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TV57254') HTTP/1.1" 204 0
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_c06e26107cd6334903bbed80b243ffc2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_22aee8eb91816a9ebb25c57e16e0e81b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_446c52758971aa5b499db68510b405d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB41449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV83163> (referer: https://www.auto1.com/v1/car-details-view/DV83163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_b7034930ce5b95529b5709ec0303783c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC51689/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41f9a10>
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fbf%252F41bfcbb1f3c4133a4718d01e6cf2814d%252Fpa%252FCA73486_6426412e6605fca3d57438d129f3d7c7.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_6426412e6605fca3d57438d129f3d7c7.jpg saved to cache
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9970f351-8e7b-5b05-806e-ef9f53ff2274
2026-03-28 11:31:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9970f351-8e7b-5b05-806e-ef9f53ff2274, skipping ID generation
2026-03-28 11:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9970f351-8e7b-5b05-806e-ef9f53ff2274 with scrape type 1
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9970f351-8e7b-5b05-806e-ef9f53ff2274 sending to next pipeline
2026-03-28 11:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9970f351-8e7b-5b05-806e-ef9f53ff2274, identifier: CA73486
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4118590>
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_1911948a96b189e3beb81016d855cdf6.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_1911948a96b189e3beb81016d855cdf6.jpg saved to cache
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986
2026-03-28 11:31:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41aa510>
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_2bc7d872e2eba48e825ba1f95e48765c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_2bc7d872e2eba48e825ba1f95e48765c.jpg saved to cache
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7851fcd-848f-552e-bb27-09862abc5ccc
2026-03-28 11:31:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4462210>
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_7e07c67c2b7423c02f319900e30fca66.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_7e07c67c2b7423c02f319900e30fca66.jpg saved to cache
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7851fcd-848f-552e-bb27-09862abc5ccc
2026-03-28 11:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9970f351-8e7b-5b05-806e-ef9f53ff2274 with identifier: CA73486
2026-03-28 11:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9970f351-8e7b-5b05-806e-ef9f53ff2274 with identifier: CA73486
2026-03-28 11:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9970f351-8e7b-5b05-806e-ef9f53ff2274 with identifier: CA73486 to the API
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_6426412e6605fca3d57438d129f3d7c7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.2L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:17:12Z',
 'fuel_type': 'diesel',
 'id': '9970f351-8e7b-5b05-806e-ef9f53ff2274',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA73486',
 'listing': 'auction',
 'location': 'BE, Aarschot',
 'make': 'Mazda',
 'model': '6',
 'odometer': 202567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331321,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_d875dd0187ed86c616f62642b9e752b4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57432,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_251d2915de4cbba57cf7630a3d3fcd24.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2837058,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_6426412e6605fca3d57438d129f3d7c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_bd235ecdc9bcab12a290a5fa6a0f9868.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_8f90cfa9304f673db95dc4f7c719c848.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2843336,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_61fe205e0d64e3571f0d614aefc1d9d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_ca0ff2cd0853b96172e0e211a86ff47e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63863,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_c115e1d87ae669cf39efd7c7a8f7a1b1.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60494,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_03fd47a65539785ca6d2bd571da8a8a4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970f351-8e7b-5b05-806e-ef9f53ff2274/9970f351-8e7b-5b05-806e-ef9f53ff2274_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2805799,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/bf/41bfcbb1f3c4133a4718d01e6cf2814d/pa/CA73486_42712d80936d9c1e8db720279c21634b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2015}
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA73486%27 HTTP/1.1" 200 None
2026-03-28 11:31:18 [auto1.be] INFO: Saving data for CA73486: {'created_time': 1774697478.778698, 'last_price_update_time': 1774697478.778708, 'auction_closing_time': 1774883832.0}
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CA73486') HTTP/1.1" 204 0
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41f3b50>
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_c06e26107cd6334903bbed80b243ffc2.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_c06e26107cd6334903bbed80b243ffc2.jpg saved to cache
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e31290>
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_22aee8eb91816a9ebb25c57e16e0e81b.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_22aee8eb91816a9ebb25c57e16e0e81b.jpg saved to cache
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42d6fd0>
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb0e50d-5171-51f2-aac4-e266009560e3/ceb0e50d-5171-51f2-aac4-e266009560e3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F81%252F3881b810309754c5096e46d1a8d22dda%252Fpa%252FEK14732_446c52758971aa5b499db68510b405d3.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_446c52758971aa5b499db68510b405d3.jpg saved to cache
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ceb0e50d-5171-51f2-aac4-e266009560e3
2026-03-28 11:31:18 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca522015-fe64-56f6-b3aa-280f5acec4b2 with identifier: DV83163
2026-03-28 11:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca522015-fe64-56f6-b3aa-280f5acec4b2 with scrape type 1
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ca522015-fe64-56f6-b3aa-280f5acec4b2
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Faa%252Fb1aa1394a93c42ebc91c5ffa0d6277df%252Fpa%252FDV83163_1b49f70346e7b5e31c28669c455bc7cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_1b49f70346e7b5e31c28669c455bc7cc.jpg not downloaded yet
2026-03-28 11:31:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4239810>
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_b7034930ce5b95529b5709ec0303783c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_b7034930ce5b95529b5709ec0303783c.jpg saved to cache
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: PR44884
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR44884%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for PR44884: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: CV18687
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: MG36975
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG36975%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for MG36975: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for PY81659: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for PE83293: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: CB57627
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB57627%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for CB57627: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: ZW84802
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW84802%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for ZW84802: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: HZ77507
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ77507%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for HZ77507: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: TM05069
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM05069%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for TM05069: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: EJ24025
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ24025%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for EJ24025: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: BY81514
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY81514%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for BY81514: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: PG30723
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG30723%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for PG30723: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: PL22892
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL22892%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for PL22892: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: AM99393
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: MS95161
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS95161%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for MS95161: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: SE96369
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE96369%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for SE96369: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for UV50609: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: XY49769
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: CX92013
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: JZ56411
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ56411%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for JZ56411: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: NY73004
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY73004%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for NY73004: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV95971%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for JV95971: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: YB34897
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: CB62754
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for AX58227: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: MD83963
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD83963%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [auto1.be] INFO: Scrape type for MD83963: 0
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: KE03465
2026-03-28 11:31:19 [auto1.be] INFO: Found listing with ID: BR84534
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Faa%252Fb1aa1394a93c42ebc91c5ffa0d6277df%252Fpa%252FDV83163_2a42b396a49e2ae769be0c0e1ef3c097.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_2a42b396a49e2ae769be0c0e1ef3c097.jpg not downloaded yet
2026-03-28 11:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Faa%252Fb1aa1394a93c42ebc91c5ffa0d6277df%252Fpa%252FDV83163_b0231ee52ffafed4faccd770f4656cc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_b0231ee52ffafed4faccd770f4656cc3.jpg not downloaded yet
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Faa%252Fb1aa1394a93c42ebc91c5ffa0d6277df%252Fpa%252FDV83163_556c4866a08271919822a7966f8d302c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_556c4866a08271919822a7966f8d302c.jpg not downloaded yet
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Faa%252Fb1aa1394a93c42ebc91c5ffa0d6277df%252Fpa%252FDV83163_a021ced41718a5ed862d267db1cfc105.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_a021ced41718a5ed862d267db1cfc105.jpg not downloaded yet
2026-03-28 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_1b49f70346e7b5e31c28669c455bc7cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Faa%252Fb1aa1394a93c42ebc91c5ffa0d6277df%252Fpa%252FDV83163_6c0de23b71da936eb70877f490e73665.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_6c0de23b71da936eb70877f490e73665.jpg not downloaded yet
2026-03-28 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_3f194f74fb27746dcde1f3710574042c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_837a1f286d2e7a7ffbea99cf70be6541.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_85be11409bd8bfae2abd1d59b2e19845.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_8978ade251299e6fc295b4288a7de59e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_a021ced41718a5ed862d267db1cfc105.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_b0231ee52ffafed4faccd770f4656cc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_6c0de23b71da936eb70877f490e73665.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d729d0>
2026-03-28 11:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca522015-fe64-56f6-b3aa-280f5acec4b2/ca522015-fe64-56f6-b3aa-280f5acec4b2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Faa%252Fb1aa1394a93c42ebc91c5ffa0d6277df%252Fpa%252FDV83163_1b49f70346e7b5e31c28669c455bc7cc.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_1b49f70346e7b5e31c28669c455bc7cc.jpg saved to cache
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca522015-fe64-56f6-b3aa-280f5acec4b2
2026-03-28 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_bca42c63cfab6ca4be4f69be1c9125f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_e86d9df0cf131359f80bf287e2537003.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa44a3e50>
2026-03-28 11:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1acef5-aad0-5707-b995-cc1bd85f4d16/3f1acef5-aad0-5707-b995-cc1bd85f4d16_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F07%252F57075965bc2f5d3f86849fd03808fad4%252Fpa%252FVX51166_3f194f74fb27746dcde1f3710574042c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_3f194f74fb27746dcde1f3710574042c.jpg saved to cache
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f1acef5-aad0-5707-b995-cc1bd85f4d16
2026-03-28 11:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4235990>
2026-03-28 11:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8f9d8e-56d3-501a-a3bf-fd247e39458e/9b8f9d8e-56d3-501a-a3bf-fd247e39458e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F08%252Fe008542458bd80f5449a17a31e3862fc%252Fpa%252FUR02836_837a1f286d2e7a7ffbea99cf70be6541.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_837a1f286d2e7a7ffbea99cf70be6541.jpg saved to cache
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b8f9d8e-56d3-501a-a3bf-fd247e39458e
2026-03-28 11:31:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b8f9d8e-56d3-501a-a3bf-fd247e39458e, skipping ID generation
2026-03-28 11:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8f9d8e-56d3-501a-a3bf-fd247e39458e with scrape type 1
2026-03-28 11:31:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b8f9d8e-56d3-501a-a3bf-fd247e39458e sending to next pipeline
2026-03-28 11:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b8f9d8e-56d3-501a-a3bf-fd247e39458e, identifier: UR02836
2026-03-28 11:31:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d39d90>
2026-03-28 11:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_85be11409bd8bfae2abd1d59b2e19845.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_85be11409bd8bfae2abd1d59b2e19845.jpg saved to cache
2026-03-28 11:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986
2026-03-28 11:31:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41d9810>
2026-03-28 11:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fe8%252Fbae8074d2437db1c70fef63418984be0%252Fpa%252FCU06988_8978ade251299e6fc295b4288a7de59e.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_8978ade251299e6fc295b4288a7de59e.jpg saved to cache
2026-03-28 11:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986
2026-03-28 11:31:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d8a5f1d-43b3-505c-80cd-d892bccfe986, skipping ID generation
2026-03-28 11:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986 with scrape type 1
2026-03-28 11:31:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986 sending to next pipeline
2026-03-28 11:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d8a5f1d-43b3-505c-80cd-d892bccfe986, identifier: CU06988
2026-03-28 11:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d4d450>
2026-03-28 11:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca522015-fe64-56f6-b3aa-280f5acec4b2/ca522015-fe64-56f6-b3aa-280f5acec4b2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Faa%252Fb1aa1394a93c42ebc91c5ffa0d6277df%252Fpa%252FDV83163_a021ced41718a5ed862d267db1cfc105.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_a021ced41718a5ed862d267db1cfc105.jpg saved to cache
2026-03-28 11:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca522015-fe64-56f6-b3aa-280f5acec4b2
2026-03-28 11:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_9d08a0e1434a84dee5e2f037a09555e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b8f9d8e-56d3-501a-a3bf-fd247e39458e with identifier: UR02836
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 11:31:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b8f9d8e-56d3-501a-a3bf-fd247e39458e with identifier: UR02836
2026-03-28 11:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b8f9d8e-56d3-501a-a3bf-fd247e39458e with identifier: UR02836 to the API
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_837a1f286d2e7a7ffbea99cf70be6541.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:04Z',
 'fuel_type': 'diesel',
 'id': '9b8f9d8e-56d3-501a-a3bf-fd247e39458e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR02836',
 'listing': 'auction',
 'location': 'BE, Herentals',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 202781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8f9d8e-56d3-501a-a3bf-fd247e39458e/9b8f9d8e-56d3-501a-a3bf-fd247e39458e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_2a60496edd99a8478a8471f546f73dd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8f9d8e-56d3-501a-a3bf-fd247e39458e/9b8f9d8e-56d3-501a-a3bf-fd247e39458e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_0e733a9065d97b24afdf195df125cb17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8f9d8e-56d3-501a-a3bf-fd247e39458e/9b8f9d8e-56d3-501a-a3bf-fd247e39458e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_837a1f286d2e7a7ffbea99cf70be6541.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8f9d8e-56d3-501a-a3bf-fd247e39458e/9b8f9d8e-56d3-501a-a3bf-fd247e39458e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_f0badfa7c2b95698f849e3b8fb7c6a74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8f9d8e-56d3-501a-a3bf-fd247e39458e/9b8f9d8e-56d3-501a-a3bf-fd247e39458e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_9607f450d33d3c57327f4b9d10718c4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8f9d8e-56d3-501a-a3bf-fd247e39458e/9b8f9d8e-56d3-501a-a3bf-fd247e39458e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/08/e008542458bd80f5449a17a31e3862fc/pa/UR02836_1a5ae42979b7ff394ab5347174e439e3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR02836%27 HTTP/1.1" 200 None
2026-03-28 11:31:20 [auto1.be] INFO: Saving data for UR02836: {'created_time': 1774697480.864288, 'last_price_update_time': 1774697480.864299, 'auction_closing_time': 1774884544.0}
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UR02836') HTTP/1.1" 204 0
2026-03-28 11:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d8a5f1d-43b3-505c-80cd-d892bccfe986 with identifier: CU06988
2026-03-28 11:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d8a5f1d-43b3-505c-80cd-d892bccfe986 with identifier: CU06988
2026-03-28 11:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d8a5f1d-43b3-505c-80cd-d892bccfe986 with identifier: CU06988 to the API
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_8978ade251299e6fc295b4288a7de59e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:06:02Z',
 'fuel_type': 'hybrid',
 'id': '8d8a5f1d-43b3-505c-80cd-d892bccfe986',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU06988',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 68299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_3440b8c34555cddfcaac919bb307c2d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_8e431d64b1f9b1dba4d7fd143ee2ca36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2627006,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_8978ade251299e6fc295b4288a7de59e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2597667,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_b7034930ce5b95529b5709ec0303783c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_644916e489ce5f9d165138126ff7927d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578913,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_85be11409bd8bfae2abd1d59b2e19845.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_1911948a96b189e3beb81016d855cdf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_7a47340c06d0f4154534bbc480eb6c4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_c06e26107cd6334903bbed80b243ffc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d8a5f1d-43b3-505c-80cd-d892bccfe986/8d8a5f1d-43b3-505c-80cd-d892bccfe986_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/e8/bae8074d2437db1c70fef63418984be0/pa/CU06988_22aee8eb91816a9ebb25c57e16e0e81b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2017}
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU06988%27 HTTP/1.1" 200 None
2026-03-28 11:31:21 [auto1.be] INFO: Saving data for CU06988: {'created_time': 1774697481.324326, 'last_price_update_time': 1774697481.324337, 'auction_closing_time': 1774883162.0}
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CU06988') HTTP/1.1" 204 0
2026-03-28 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_556c4866a08271919822a7966f8d302c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC51689> (referer: https://www.auto1.com/v1/car-details-view/RC51689/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU93740> (referer: https://www.auto1.com/v1/car-details-view/PU93740/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB41449> (referer: https://www.auto1.com/v1/car-details-view/KB41449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV58665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU94491> (referer: https://www.auto1.com/v1/car-details-view/JU94491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE94103/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d26250>
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca522015-fe64-56f6-b3aa-280f5acec4b2/ca522015-fe64-56f6-b3aa-280f5acec4b2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Faa%252Fb1aa1394a93c42ebc91c5ffa0d6277df%252Fpa%252FDV83163_b0231ee52ffafed4faccd770f4656cc3.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_b0231ee52ffafed4faccd770f4656cc3.jpg saved to cache
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca522015-fe64-56f6-b3aa-280f5acec4b2
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41d1b90>
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca522015-fe64-56f6-b3aa-280f5acec4b2/ca522015-fe64-56f6-b3aa-280f5acec4b2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Faa%252Fb1aa1394a93c42ebc91c5ffa0d6277df%252Fpa%252FDV83163_6c0de23b71da936eb70877f490e73665.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_6c0de23b71da936eb70877f490e73665.jpg saved to cache
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca522015-fe64-56f6-b3aa-280f5acec4b2
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4185550>
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_bca42c63cfab6ca4be4f69be1c9125f7.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_bca42c63cfab6ca4be4f69be1c9125f7.jpg saved to cache
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef856ef4-db6c-5637-9d07-afdae111ee37
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa40e01d0>
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_e86d9df0cf131359f80bf287e2537003.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_e86d9df0cf131359f80bf287e2537003.jpg saved to cache
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7851fcd-848f-552e-bb27-09862abc5ccc
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4ce7a90>
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb0e50d-5171-51f2-aac4-e266009560e3/ceb0e50d-5171-51f2-aac4-e266009560e3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F81%252F3881b810309754c5096e46d1a8d22dda%252Fpa%252FEK14732_9d08a0e1434a84dee5e2f037a09555e0.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_9d08a0e1434a84dee5e2f037a09555e0.jpg saved to cache
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ceb0e50d-5171-51f2-aac4-e266009560e3
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa436b6d0>
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca522015-fe64-56f6-b3aa-280f5acec4b2/ca522015-fe64-56f6-b3aa-280f5acec4b2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Faa%252Fb1aa1394a93c42ebc91c5ffa0d6277df%252Fpa%252FDV83163_556c4866a08271919822a7966f8d302c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_556c4866a08271919822a7966f8d302c.jpg saved to cache
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca522015-fe64-56f6-b3aa-280f5acec4b2
2026-03-28 11:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 771730b6-0b82-5d01-8b53-b1a8ab9642af with identifier: RC51689
2026-03-28 11:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 771730b6-0b82-5d01-8b53-b1a8ab9642af with scrape type 1
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 771730b6-0b82-5d01-8b53-b1a8ab9642af
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_cd2bb4ae183077c1cda50b47a37fd9dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_cd2bb4ae183077c1cda50b47a37fd9dc.jpg not downloaded yet
2026-03-28 11:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d17c10e0-e10f-521d-81c0-79a0f63ac5a0 with identifier: PU93740
2026-03-28 11:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d17c10e0-e10f-521d-81c0-79a0f63ac5a0 with scrape type 1
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d17c10e0-e10f-521d-81c0-79a0f63ac5a0
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_ce8e03fcfe27ada17a9bc8d769009d00.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_ce8e03fcfe27ada17a9bc8d769009d00.jpg not downloaded yet
2026-03-28 11:31:21 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43f12160-f078-597b-82c3-d3f29410dc70 with identifier: KB41449
2026-03-28 11:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43f12160-f078-597b-82c3-d3f29410dc70 with scrape type 1
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43f12160-f078-597b-82c3-d3f29410dc70
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_27ec13d832b10f4ca006b90ad1e6695f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_27ec13d832b10f4ca006b90ad1e6695f.jpg not downloaded yet
2026-03-28 11:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acf55a91-a1a3-58c3-b51d-8ff5bea44810 with identifier: JU94491
2026-03-28 11:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acf55a91-a1a3-58c3-b51d-8ff5bea44810 with scrape type 1
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item acf55a91-a1a3-58c3-b51d-8ff5bea44810
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_987caf2e3ecfaad978dfe6dac106839c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_987caf2e3ecfaad978dfe6dac106839c.jpg not downloaded yet
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_1bca98656c7545b16274b3023ab8d411.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_1bca98656c7545b16274b3023ab8d411.jpg not downloaded yet
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_a4f93641c82859ef2e1e74dd12a97c5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_a4f93641c82859ef2e1e74dd12a97c5f.jpg not downloaded yet
2026-03-28 11:31:21 [auto1.be] INFO: Found listing with ID: TA85166
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA85166%27 HTTP/1.1" 200 None
2026-03-28 11:31:21 [auto1.be] INFO: Scrape type for TA85166: 0
2026-03-28 11:31:21 [auto1.be] INFO: Found listing with ID: ZW31488
2026-03-28 11:31:21 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-28 11:31:21 [auto1.be] INFO: Scrape type for ET09366: 0
2026-03-28 11:31:21 [auto1.be] INFO: Found listing with ID: JE01185
2026-03-28 11:31:21 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-28 11:31:21 [auto1.be] INFO: Found listing with ID: CE95179
2026-03-28 11:31:21 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-28 11:31:21 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-28 11:31:21 [auto1.be] INFO: Found listing with ID: LJ80656
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ80656%27 HTTP/1.1" 200 None
2026-03-28 11:31:21 [auto1.be] INFO: Scrape type for LJ80656: 0
2026-03-28 11:31:21 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-28 11:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for GX61337: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: JT01513
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for XC64567: 2
2026-03-28 11:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8496672-691f-50a0-a869-7b1468276996 with identifier: XC64567
2026-03-28 11:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8496672-691f-50a0-a869-7b1468276996 with scrape type 2
2026-03-28 11:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8496672-691f-50a0-a869-7b1468276996 with scrape type 2
2026-03-28 11:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8496672-691f-50a0-a869-7b1468276996, identifier: XC64567
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_527b4d0286ba9f2322fdea5182de333e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_527b4d0286ba9f2322fdea5182de333e.jpg not downloaded yet
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_db8a6c218533d4a5bdc6f56310f8ee5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_db8a6c218533d4a5bdc6f56310f8ee5a.jpg not downloaded yet
2026-03-28 11:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_90ef98a27cd3b9d291d95d2b5426a765.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_5134dab408a1f982825d99c634531cc9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_f725be4a5c16c22c3008a2e520d0efd3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_2a42b396a49e2ae769be0c0e1ef3c097.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8496672-691f-50a0-a869-7b1468276996 with identifier: XC64567
2026-03-28 11:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8496672-691f-50a0-a869-7b1468276996 with identifier: XC64567
2026-03-28 11:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8496672-691f-50a0-a869-7b1468276996 with identifier: XC64567 to the API
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:10:32Z',
 'fuel_type': 'diesel',
 'id': 'd8496672-691f-50a0-a869-7b1468276996',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC64567',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 267799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Saving data for XC64567: {'auction_closing_time': 1774714232.0, 'created_time': 1773348577.123637, 'last_price_update_time': 1774697482.484234}
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC64567') HTTP/1.1" 204 0
2026-03-28 11:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV92885> (referer: https://www.auto1.com/v1/car-details-view/GV92885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_0e4bdeea8aae97f790c83e466ea0d9b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_0e4bdeea8aae97f790c83e466ea0d9b8.jpg not downloaded yet
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_eff177f1d94091c05ec37aa05568292b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_eff177f1d94091c05ec37aa05568292b.jpg not downloaded yet
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for NG90127: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: TD99955
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD99955%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for TD99955: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: MW20724
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW20724%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for MW20724: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14526%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for ZH14526: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for TW64249: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: SD94146
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD94146%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for SD94146: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: KA04949
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA04949%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for KA04949: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: NK67799
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK67799%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for NK67799: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: XX33825
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX33825%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for XX33825: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: VH72500
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH72500%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for VH72500: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: PT71351
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT71351%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for PT71351: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: ZY41289
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY41289%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for ZY41289: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: UK54549
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK54549%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for UK54549: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: CW00167
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: HY69206
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY69206%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for HY69206: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: KR25355
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR25355%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for KR25355: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: ED19448
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED19448%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for ED19448: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-28 11:31:22 [auto1.be] INFO: Scrape type for CS08088: 0
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: NG88652
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: NP41015
2026-03-28 11:31:22 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_a4c449beef40cf7302c137e8cc67821d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_a4c449beef40cf7302c137e8cc67821d.jpg not downloaded yet
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_51e972ab79c0ab876e45e8003b034a2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_51e972ab79c0ab876e45e8003b034a2d.jpg not downloaded yet
2026-03-28 11:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_e11dcb1df490d19780ef3a779a7832d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_88bf20465719533ba7e3dc6394dc88ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_e118a421fc84aae1c87b7c43bd4387b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_b93743681907f19b1075a5161965c94b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_b93743681907f19b1075a5161965c94b.jpg not downloaded yet
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_5efb993322ab84a30eab86ed347b707f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_5efb993322ab84a30eab86ed347b707f.jpg not downloaded yet
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_9cb4c94c0eccb997dfb9f1c1efdf9da7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_9cb4c94c0eccb997dfb9f1c1efdf9da7.jpg not downloaded yet
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_37e119479c1ed5d271f0a97fe757e690.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_37e119479c1ed5d271f0a97fe757e690.jpg not downloaded yet
2026-03-28 11:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_befaa09b9a2c9fa36229b49467adc77c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_0db5a595a9cdbf1415182d69e3fc65f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_98d6b909ae11e70b5dda8c3e9a4ab032.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d3ab90>
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_90ef98a27cd3b9d291d95d2b5426a765.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_90ef98a27cd3b9d291d95d2b5426a765.jpg saved to cache
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42c94d0>
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F92%252Fcd92212aa3da8628ab19cbd29c31be2b%252Fpa%252FTX50404_5134dab408a1f982825d99c634531cc9.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_5134dab408a1f982825d99c634531cc9.jpg saved to cache
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115
2026-03-28 11:31:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115, skipping ID generation
2026-03-28 11:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115 with scrape type 1
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115 sending to next pipeline
2026-03-28 11:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115, identifier: TX50404
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4431e90>
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1acef5-aad0-5707-b995-cc1bd85f4d16/3f1acef5-aad0-5707-b995-cc1bd85f4d16_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F07%252F57075965bc2f5d3f86849fd03808fad4%252Fpa%252FVX51166_f725be4a5c16c22c3008a2e520d0efd3.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_f725be4a5c16c22c3008a2e520d0efd3.jpg saved to cache
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f1acef5-aad0-5707-b995-cc1bd85f4d16
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4247890>
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca522015-fe64-56f6-b3aa-280f5acec4b2/ca522015-fe64-56f6-b3aa-280f5acec4b2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Faa%252Fb1aa1394a93c42ebc91c5ffa0d6277df%252Fpa%252FDV83163_2a42b396a49e2ae769be0c0e1ef3c097.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_2a42b396a49e2ae769be0c0e1ef3c097.jpg saved to cache
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca522015-fe64-56f6-b3aa-280f5acec4b2
2026-03-28 11:31:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca522015-fe64-56f6-b3aa-280f5acec4b2, skipping ID generation
2026-03-28 11:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca522015-fe64-56f6-b3aa-280f5acec4b2 with scrape type 1
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca522015-fe64-56f6-b3aa-280f5acec4b2 sending to next pipeline
2026-03-28 11:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ca522015-fe64-56f6-b3aa-280f5acec4b2, identifier: DV83163
2026-03-28 11:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5f1525d-7fab-55ed-ac31-bf203cdec17c with identifier: GV92885
2026-03-28 11:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5f1525d-7fab-55ed-ac31-bf203cdec17c with scrape type 1
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5f1525d-7fab-55ed-ac31-bf203cdec17c
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F30%252F0d30961d100b76b08285350c550946cc%252Fpa%252FGV92885_39b04a2a3466c732ae26de1c31fb04c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_39b04a2a3466c732ae26de1c31fb04c5.jpg already downloaded
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F30%252F0d30961d100b76b08285350c550946cc%252Fpa%252FGV92885_98e0e6925ca325c4613eb4d12928469b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_98e0e6925ca325c4613eb4d12928469b.jpg already downloaded
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F30%252F0d30961d100b76b08285350c550946cc%252Fpa%252FGV92885_84b9c23befd0d6e934d3cd24518d9b8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_84b9c23befd0d6e934d3cd24518d9b8f.jpg already downloaded
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F30%252F0d30961d100b76b08285350c550946cc%252Fpa%252FGV92885_828fe194bf3b05aacb6a16a1e85653eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_828fe194bf3b05aacb6a16a1e85653eb.jpg already downloaded
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F30%252F0d30961d100b76b08285350c550946cc%252Fpa%252FGV92885_85e3cc082ee7d0ed08b7791d074764a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_85e3cc082ee7d0ed08b7791d074764a2.jpg already downloaded
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F30%252F0d30961d100b76b08285350c550946cc%252Fpa%252FGV92885_fa9f1c288b7540e811d2e81953af7fb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_fa9f1c288b7540e811d2e81953af7fb7.jpg already downloaded
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F30%252F0d30961d100b76b08285350c550946cc%252Fpa%252FGV92885_9d37b7f69bc87642ade7f90920bf6abe.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_9d37b7f69bc87642ade7f90920bf6abe.jpg already downloaded
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F30%252F0d30961d100b76b08285350c550946cc%252Fpa%252FGV92885_7c48c0e41f28c6359b21295d7a3cf0dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_7c48c0e41f28c6359b21295d7a3cf0dd.jpg already downloaded
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F30%252F0d30961d100b76b08285350c550946cc%252Fpa%252FGV92885_c3e0155def5f17994dbef5facf68c28b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_c3e0155def5f17994dbef5facf68c28b.jpg already downloaded
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F30%252F0d30961d100b76b08285350c550946cc%252Fpa%252FGV92885_31ddff3acc4bccd8cb7a126246f576cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_31ddff3acc4bccd8cb7a126246f576cd.jpg already downloaded
2026-03-28 11:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b5f1525d-7fab-55ed-ac31-bf203cdec17c, identifier: GV92885
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_5e81a65173e460abdde22cb05ec53f87.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_5e81a65173e460abdde22cb05ec53f87.jpg not downloaded yet
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_d2ea65b200bcbe019560aebf8ebb857b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_d2ea65b200bcbe019560aebf8ebb857b.jpg not downloaded yet
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_53c6dcfb5a5a85b576d06b6f0978ce8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_53c6dcfb5a5a85b576d06b6f0978ce8e.jpg not downloaded yet
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_ca0fadedb3c774af9a70163981992535.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_ca0fadedb3c774af9a70163981992535.jpg not downloaded yet
2026-03-28 11:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115 with identifier: TX50404
2026-03-28 11:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115 with identifier: TX50404
2026-03-28 11:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115 with identifier: TX50404 to the API
2026-03-28 11:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_5134dab408a1f982825d99c634531cc9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:27:56Z',
 'fuel_type': 'petrol',
 'id': 'dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX50404',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 62939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_5134dab408a1f982825d99c634531cc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_90ef98a27cd3b9d291d95d2b5426a765.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_28a6f87c7de0de1ef84a9cfc94377124.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_59c34f2b5b9e59547f0ba82e03ef4083.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_4faccf71e553a2ba0a644377770e17c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_43aa5f5f360be0962583a88553054dc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_848dbe3e7efad41f284ab0c6ba2f9fb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_9832c62e4996af7f4a7e59d1336a3b62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_bd7fc49169067cb9cf3fe08d7a6ed1c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115/dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/92/cd92212aa3da8628ab19cbd29c31be2b/pa/TX50404_c3abadbc83fdb1ffac240bb1fc6e259a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2020}
2026-03-28 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50404%27 HTTP/1.1" 200 None
2026-03-28 11:31:24 [auto1.be] INFO: Saving data for TX50404: {'created_time': 1774697484.229791, 'last_price_update_time': 1774697484.229802, 'auction_closing_time': 1774884476.0}
2026-03-28 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX50404') HTTP/1.1" 204 0
2026-03-28 11:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ca522015-fe64-56f6-b3aa-280f5acec4b2 with identifier: DV83163
2026-03-28 11:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ca522015-fe64-56f6-b3aa-280f5acec4b2 with identifier: DV83163
2026-03-28 11:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ca522015-fe64-56f6-b3aa-280f5acec4b2 with identifier: DV83163 to the API
2026-03-28 11:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_2a42b396a49e2ae769be0c0e1ef3c097.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:30:34Z',
 'fuel_type': 'petrol',
 'id': 'ca522015-fe64-56f6-b3aa-280f5acec4b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV83163',
 'listing': 'auction',
 'location': 'BE, Brugge',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 81993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca522015-fe64-56f6-b3aa-280f5acec4b2/ca522015-fe64-56f6-b3aa-280f5acec4b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_1b49f70346e7b5e31c28669c455bc7cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca522015-fe64-56f6-b3aa-280f5acec4b2/ca522015-fe64-56f6-b3aa-280f5acec4b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_2a42b396a49e2ae769be0c0e1ef3c097.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca522015-fe64-56f6-b3aa-280f5acec4b2/ca522015-fe64-56f6-b3aa-280f5acec4b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_b0231ee52ffafed4faccd770f4656cc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca522015-fe64-56f6-b3aa-280f5acec4b2/ca522015-fe64-56f6-b3aa-280f5acec4b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_556c4866a08271919822a7966f8d302c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca522015-fe64-56f6-b3aa-280f5acec4b2/ca522015-fe64-56f6-b3aa-280f5acec4b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_a021ced41718a5ed862d267db1cfc105.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca522015-fe64-56f6-b3aa-280f5acec4b2/ca522015-fe64-56f6-b3aa-280f5acec4b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/aa/b1aa1394a93c42ebc91c5ffa0d6277df/pa/DV83163_6c0de23b71da936eb70877f490e73665.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Cruze 1.6 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2012}
2026-03-28 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV83163%27 HTTP/1.1" 200 None
2026-03-28 11:31:24 [auto1.be] INFO: Saving data for DV83163: {'created_time': 1774697484.949763, 'last_price_update_time': 1774697484.949772, 'auction_closing_time': 1774884634.0}
2026-03-28 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DV83163') HTTP/1.1" 204 0
2026-03-28 11:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b5f1525d-7fab-55ed-ac31-bf203cdec17c with identifier: GV92885
2026-03-28 11:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b5f1525d-7fab-55ed-ac31-bf203cdec17c with identifier: GV92885
2026-03-28 11:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b5f1525d-7fab-55ed-ac31-bf203cdec17c with identifier: GV92885 to the API
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GV92885>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:51:20Z',
 'fuel_type': 'petrol',
 'id': 'b5f1525d-7fab-55ed-ac31-bf203cdec17c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV92885',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 119374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_39b04a2a3466c732ae26de1c31fb04c5.jpg',
                'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_98e0e6925ca325c4613eb4d12928469b.jpg',
                'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_84b9c23befd0d6e934d3cd24518d9b8f.jpg',
                'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_828fe194bf3b05aacb6a16a1e85653eb.jpg',
                'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_85e3cc082ee7d0ed08b7791d074764a2.jpg',
                'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_fa9f1c288b7540e811d2e81953af7fb7.jpg',
                'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_9d37b7f69bc87642ade7f90920bf6abe.jpg',
                'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_7c48c0e41f28c6359b21295d7a3cf0dd.jpg',
                'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_c3e0155def5f17994dbef5facf68c28b.jpg',
                'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_31ddff3acc4bccd8cb7a126246f576cd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1525d-7fab-55ed-ac31-bf203cdec17c/b5f1525d-7fab-55ed-ac31-bf203cdec17c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2340643,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_39b04a2a3466c732ae26de1c31fb04c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1525d-7fab-55ed-ac31-bf203cdec17c/b5f1525d-7fab-55ed-ac31-bf203cdec17c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2394376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_98e0e6925ca325c4613eb4d12928469b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1525d-7fab-55ed-ac31-bf203cdec17c/b5f1525d-7fab-55ed-ac31-bf203cdec17c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2323004,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_84b9c23befd0d6e934d3cd24518d9b8f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1525d-7fab-55ed-ac31-bf203cdec17c/b5f1525d-7fab-55ed-ac31-bf203cdec17c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_828fe194bf3b05aacb6a16a1e85653eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1525d-7fab-55ed-ac31-bf203cdec17c/b5f1525d-7fab-55ed-ac31-bf203cdec17c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_85e3cc082ee7d0ed08b7791d074764a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1525d-7fab-55ed-ac31-bf203cdec17c/b5f1525d-7fab-55ed-ac31-bf203cdec17c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2368212,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_fa9f1c288b7540e811d2e81953af7fb7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1525d-7fab-55ed-ac31-bf203cdec17c/b5f1525d-7fab-55ed-ac31-bf203cdec17c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2474117,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_9d37b7f69bc87642ade7f90920bf6abe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1525d-7fab-55ed-ac31-bf203cdec17c/b5f1525d-7fab-55ed-ac31-bf203cdec17c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2325252,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_7c48c0e41f28c6359b21295d7a3cf0dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1525d-7fab-55ed-ac31-bf203cdec17c/b5f1525d-7fab-55ed-ac31-bf203cdec17c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2331113,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_c3e0155def5f17994dbef5facf68c28b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f1525d-7fab-55ed-ac31-bf203cdec17c/b5f1525d-7fab-55ed-ac31-bf203cdec17c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2444813,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/30/0d30961d100b76b08285350c550946cc/pa/GV92885_31ddff3acc4bccd8cb7a126246f576cd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Young',
 'transmission': 'manual',
 'trim': 'Young',
 'year': 2016}
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV92885%27 HTTP/1.1" 200 None
2026-03-28 11:31:25 [auto1.be] INFO: Saving data for GV92885: {'created_time': 1774697485.313745, 'last_price_update_time': 1774697485.313755, 'auction_closing_time': 1774885880.0}
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GV92885') HTTP/1.1" 204 0
2026-03-28 11:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_987caf2e3ecfaad978dfe6dac106839c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_27ec13d832b10f4ca006b90ad1e6695f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_db8a6c218533d4a5bdc6f56310f8ee5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_a456ebf77a89ddcaa371abdedc3f108e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_a456ebf77a89ddcaa371abdedc3f108e.jpg not downloaded yet
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_e4b02388fbe8135e0ce09343a09df38e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_e4b02388fbe8135e0ce09343a09df38e.jpg not downloaded yet
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_a21637224eed7fd6bd9d52d77fb10b57.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_a21637224eed7fd6bd9d52d77fb10b57.jpg not downloaded yet
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_cf6d2858ef4d4c9e6ad88ae6b6a716c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_cf6d2858ef4d4c9e6ad88ae6b6a716c6.jpg not downloaded yet
2026-03-28 11:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ51820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW60531/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH65741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42349d0>
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb0e50d-5171-51f2-aac4-e266009560e3/ceb0e50d-5171-51f2-aac4-e266009560e3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F81%252F3881b810309754c5096e46d1a8d22dda%252Fpa%252FEK14732_e11dcb1df490d19780ef3a779a7832d9.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_e11dcb1df490d19780ef3a779a7832d9.jpg saved to cache
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ceb0e50d-5171-51f2-aac4-e266009560e3
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42752d0>
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_88bf20465719533ba7e3dc6394dc88ca.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_88bf20465719533ba7e3dc6394dc88ca.jpg saved to cache
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7851fcd-848f-552e-bb27-09862abc5ccc
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8a97cf9510>
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_e118a421fc84aae1c87b7c43bd4387b4.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_e118a421fc84aae1c87b7c43bd4387b4.jpg saved to cache
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef856ef4-db6c-5637-9d07-afdae111ee37
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8a97cf81d0>
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1acef5-aad0-5707-b995-cc1bd85f4d16/3f1acef5-aad0-5707-b995-cc1bd85f4d16_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F07%252F57075965bc2f5d3f86849fd03808fad4%252Fpa%252FVX51166_befaa09b9a2c9fa36229b49467adc77c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_befaa09b9a2c9fa36229b49467adc77c.jpg saved to cache
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f1acef5-aad0-5707-b995-cc1bd85f4d16
2026-03-28 11:31:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f1acef5-aad0-5707-b995-cc1bd85f4d16, skipping ID generation
2026-03-28 11:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f1acef5-aad0-5707-b995-cc1bd85f4d16 with scrape type 1
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f1acef5-aad0-5707-b995-cc1bd85f4d16 sending to next pipeline
2026-03-28 11:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3f1acef5-aad0-5707-b995-cc1bd85f4d16, identifier: VX51166
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41a06d0>
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb0e50d-5171-51f2-aac4-e266009560e3/ceb0e50d-5171-51f2-aac4-e266009560e3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F81%252F3881b810309754c5096e46d1a8d22dda%252Fpa%252FEK14732_0db5a595a9cdbf1415182d69e3fc65f8.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_0db5a595a9cdbf1415182d69e3fc65f8.jpg saved to cache
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ceb0e50d-5171-51f2-aac4-e266009560e3
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa418b4d0>
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb0e50d-5171-51f2-aac4-e266009560e3/ceb0e50d-5171-51f2-aac4-e266009560e3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F81%252F3881b810309754c5096e46d1a8d22dda%252Fpa%252FEK14732_98d6b909ae11e70b5dda8c3e9a4ab032.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_98d6b909ae11e70b5dda8c3e9a4ab032.jpg saved to cache
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ceb0e50d-5171-51f2-aac4-e266009560e3
2026-03-28 11:31:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ceb0e50d-5171-51f2-aac4-e266009560e3, skipping ID generation
2026-03-28 11:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceb0e50d-5171-51f2-aac4-e266009560e3 with scrape type 1
2026-03-28 11:31:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ceb0e50d-5171-51f2-aac4-e266009560e3 sending to next pipeline
2026-03-28 11:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ceb0e50d-5171-51f2-aac4-e266009560e3, identifier: EK14732
2026-03-28 11:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_a4f93641c82859ef2e1e74dd12a97c5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3f1acef5-aad0-5707-b995-cc1bd85f4d16 with identifier: VX51166
2026-03-28 11:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3f1acef5-aad0-5707-b995-cc1bd85f4d16 with identifier: VX51166
2026-03-28 11:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3f1acef5-aad0-5707-b995-cc1bd85f4d16 with identifier: VX51166 to the API
2026-03-28 11:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_befaa09b9a2c9fa36229b49467adc77c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:51:55Z',
 'fuel_type': 'diesel',
 'id': '3f1acef5-aad0-5707-b995-cc1bd85f4d16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX51166',
 'listing': 'auction',
 'location': 'BE, Tradein',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 224668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1acef5-aad0-5707-b995-cc1bd85f4d16/3f1acef5-aad0-5707-b995-cc1bd85f4d16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_af6244ca0f658e7f9a2c34b99992709e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1acef5-aad0-5707-b995-cc1bd85f4d16/3f1acef5-aad0-5707-b995-cc1bd85f4d16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_7fd22f71c837e7d45e1c812d27ec1f3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1acef5-aad0-5707-b995-cc1bd85f4d16/3f1acef5-aad0-5707-b995-cc1bd85f4d16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_befaa09b9a2c9fa36229b49467adc77c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1acef5-aad0-5707-b995-cc1bd85f4d16/3f1acef5-aad0-5707-b995-cc1bd85f4d16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_f725be4a5c16c22c3008a2e520d0efd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1acef5-aad0-5707-b995-cc1bd85f4d16/3f1acef5-aad0-5707-b995-cc1bd85f4d16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_3f194f74fb27746dcde1f3710574042c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1acef5-aad0-5707-b995-cc1bd85f4d16/3f1acef5-aad0-5707-b995-cc1bd85f4d16_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/07/57075965bc2f5d3f86849fd03808fad4/pa/VX51166_0122620d2db4cab22636bb770295506c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2010}
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX51166%27 HTTP/1.1" 200 None
2026-03-28 11:31:26 [auto1.be] INFO: Saving data for VX51166: {'created_time': 1774697486.232844, 'last_price_update_time': 1774697486.232856, 'auction_closing_time': 1774885915.0}
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VX51166') HTTP/1.1" 204 0
2026-03-28 11:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ceb0e50d-5171-51f2-aac4-e266009560e3 with identifier: EK14732
2026-03-28 11:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ceb0e50d-5171-51f2-aac4-e266009560e3 with identifier: EK14732
2026-03-28 11:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ceb0e50d-5171-51f2-aac4-e266009560e3 with identifier: EK14732 to the API
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_98d6b909ae11e70b5dda8c3e9a4ab032.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:59:14Z',
 'fuel_type': 'petrol',
 'id': 'ceb0e50d-5171-51f2-aac4-e266009560e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK14732',
 'listing': 'auction',
 'location': 'BE, Charleroi',
 'make': 'Dacia',
 'model': 'Logan',
 'odometer': 98478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb0e50d-5171-51f2-aac4-e266009560e3/ceb0e50d-5171-51f2-aac4-e266009560e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_155e33cf6262387f7ff83fcd4c248d55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb0e50d-5171-51f2-aac4-e266009560e3/ceb0e50d-5171-51f2-aac4-e266009560e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_98d6b909ae11e70b5dda8c3e9a4ab032.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb0e50d-5171-51f2-aac4-e266009560e3/ceb0e50d-5171-51f2-aac4-e266009560e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_0db5a595a9cdbf1415182d69e3fc65f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb0e50d-5171-51f2-aac4-e266009560e3/ceb0e50d-5171-51f2-aac4-e266009560e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_e11dcb1df490d19780ef3a779a7832d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb0e50d-5171-51f2-aac4-e266009560e3/ceb0e50d-5171-51f2-aac4-e266009560e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_9d08a0e1434a84dee5e2f037a09555e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb0e50d-5171-51f2-aac4-e266009560e3/ceb0e50d-5171-51f2-aac4-e266009560e3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/81/3881b810309754c5096e46d1a8d22dda/pa/EK14732_446c52758971aa5b499db68510b405d3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Logan 1.2 Black Line 2',
 'transmission': 'manual',
 'trim': 'Black Line 2',
 'year': 2012}
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK14732%27 HTTP/1.1" 200 None
2026-03-28 11:31:26 [auto1.be] INFO: Saving data for EK14732: {'created_time': 1774697486.612962, 'last_price_update_time': 1774697486.612972, 'auction_closing_time': 1774886354.0}
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK14732') HTTP/1.1" 204 0
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_59ed92d43025eff3b8cec5c9b59d149d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_59ed92d43025eff3b8cec5c9b59d149d.jpg not downloaded yet
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_3be5ff4689d34bc4c3f939e6d43f3c6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_3be5ff4689d34bc4c3f939e6d43f3c6e.jpg not downloaded yet
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_81e49a19436c0c0f976597ad7ad2b17d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_81e49a19436c0c0f976597ad7ad2b17d.jpg not downloaded yet
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_1b6dd40156361b4e49129a445cd62737.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_1b6dd40156361b4e49129a445cd62737.jpg not downloaded yet
2026-03-28 11:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_eff177f1d94091c05ec37aa05568292b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE94103> (referer: https://www.auto1.com/v1/car-details-view/NE94103/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV58665> (referer: https://www.auto1.com/v1/car-details-view/CV58665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_51e972ab79c0ab876e45e8003b034a2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_a4c449beef40cf7302c137e8cc67821d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_225066336eaa6bf6f1a9da81e3b8cabc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_225066336eaa6bf6f1a9da81e3b8cabc.jpg not downloaded yet
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_39d3de45d06f557f5ad28195341e3e75.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_39d3de45d06f557f5ad28195341e3e75.jpg already downloaded
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_9bf0d2f22afbc4cef769806a12c16544.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_9bf0d2f22afbc4cef769806a12c16544.jpg already downloaded
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_649e9abc7c33d26b6085448970b47d20.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_649e9abc7c33d26b6085448970b47d20.jpg already downloaded
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_483b3da2a0c70fb92b1d0edeb87b5d0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_483b3da2a0c70fb92b1d0edeb87b5d0c.jpg not downloaded yet
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_339d2c0dd69e586ba5516063d5191c4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_339d2c0dd69e586ba5516063d5191c4d.jpg not downloaded yet
2026-03-28 11:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa418c850>
2026-03-28 11:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_987caf2e3ecfaad978dfe6dac106839c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_987caf2e3ecfaad978dfe6dac106839c.jpg saved to cache
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acf55a91-a1a3-58c3-b51d-8ff5bea44810
2026-03-28 11:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa419e1d0>
2026-03-28 11:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_27ec13d832b10f4ca006b90ad1e6695f.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_27ec13d832b10f4ca006b90ad1e6695f.jpg saved to cache
2026-03-28 11:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43f12160-f078-597b-82c3-d3f29410dc70
2026-03-28 11:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42ba610>
2026-03-28 11:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_db8a6c218533d4a5bdc6f56310f8ee5a.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_db8a6c218533d4a5bdc6f56310f8ee5a.jpg saved to cache
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acf55a91-a1a3-58c3-b51d-8ff5bea44810
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e5b950>
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_a4f93641c82859ef2e1e74dd12a97c5f.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_a4f93641c82859ef2e1e74dd12a97c5f.jpg saved to cache
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d17c10e0-e10f-521d-81c0-79a0f63ac5a0
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_e1edc3da789541bff87c3119726d72dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_e1edc3da789541bff87c3119726d72dd.jpg not downloaded yet
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_85518007a1a67759a89fbf489d04dbd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_85518007a1a67759a89fbf489d04dbd5.jpg not downloaded yet
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_12e5127ad18aeb33d13d56a509c472e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_12e5127ad18aeb33d13d56a509c472e7.jpg not downloaded yet
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4128e10>
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_eff177f1d94091c05ec37aa05568292b.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_eff177f1d94091c05ec37aa05568292b.jpg saved to cache
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d17c10e0-e10f-521d-81c0-79a0f63ac5a0
2026-03-28 11:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed6ad94f-670c-5b81-852b-8f1e7fab46ab with identifier: NE94103
2026-03-28 11:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed6ad94f-670c-5b81-852b-8f1e7fab46ab with scrape type 1
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ed6ad94f-670c-5b81-852b-8f1e7fab46ab
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F82%252Fdd826a6818b137915f7d109f5ce9cf0d%252Fpa%252FNE94103_1ae5591d31c89c5a5aa84c532ba05d7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_1ae5591d31c89c5a5aa84c532ba05d7c.jpg not downloaded yet
2026-03-28 11:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2 with identifier: CV58665
2026-03-28 11:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2 with scrape type 1
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_28c3cf770be70661cf33961244afc775.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_28c3cf770be70661cf33961244afc775.jpg not downloaded yet
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4337d10>
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_51e972ab79c0ab876e45e8003b034a2d.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_51e972ab79c0ab876e45e8003b034a2d.jpg saved to cache
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acf55a91-a1a3-58c3-b51d-8ff5bea44810
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4281d10>
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_a4c449beef40cf7302c137e8cc67821d.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_a4c449beef40cf7302c137e8cc67821d.jpg saved to cache
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43f12160-f078-597b-82c3-d3f29410dc70
2026-03-28 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_53c6dcfb5a5a85b576d06b6f0978ce8e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_e3a5d8f76ecb6b52cc16f48469d1f7fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_e3a5d8f76ecb6b52cc16f48469d1f7fd.jpg not downloaded yet
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_325b6bf5000c7d2242e52a998e8eca3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_325b6bf5000c7d2242e52a998e8eca3f.jpg not downloaded yet
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_9ba9c20ebbe89948830c6afd91c7283a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_9ba9c20ebbe89948830c6afd91c7283a.jpg not downloaded yet
2026-03-28 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_527b4d0286ba9f2322fdea5182de333e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_d2ea65b200bcbe019560aebf8ebb857b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F82%252Fdd826a6818b137915f7d109f5ce9cf0d%252Fpa%252FNE94103_b52bab9c372b9c5dd890513ca83ae6cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_b52bab9c372b9c5dd890513ca83ae6cc.jpg not downloaded yet
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_e96ad4c855d50706816c3c74ea1db63f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_e96ad4c855d50706816c3c74ea1db63f.jpg not downloaded yet
2026-03-28 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_cf6d2858ef4d4c9e6ad88ae6b6a716c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F82%252Fdd826a6818b137915f7d109f5ce9cf0d%252Fpa%252FNE94103_1a242d9ff566b065965665a0dac3bb57.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_1a242d9ff566b065965665a0dac3bb57.jpg not downloaded yet
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_dade59559329c29b2c4dc36a7e787db0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_dade59559329c29b2c4dc36a7e787db0.jpg not downloaded yet
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F82%252Fdd826a6818b137915f7d109f5ce9cf0d%252Fpa%252FNE94103_868882a9119692f5766c1c7e8a3e09af.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_868882a9119692f5766c1c7e8a3e09af.jpg not downloaded yet
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_52978a0df0ff72d0612f56658cdb8a05.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_52978a0df0ff72d0612f56658cdb8a05.jpg not downloaded yet
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa442f050>
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_53c6dcfb5a5a85b576d06b6f0978ce8e.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_53c6dcfb5a5a85b576d06b6f0978ce8e.jpg saved to cache
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43f12160-f078-597b-82c3-d3f29410dc70
2026-03-28 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_e4b02388fbe8135e0ce09343a09df38e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F82%252Fdd826a6818b137915f7d109f5ce9cf0d%252Fpa%252FNE94103_b1c7caa93b22d86d45e6a86635229060.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_b1c7caa93b22d86d45e6a86635229060.jpg not downloaded yet
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_e8d5e66c8ce71c2d94f9e696b4f9e1ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_e8d5e66c8ce71c2d94f9e696b4f9e1ef.jpg not downloaded yet
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F82%252Fdd826a6818b137915f7d109f5ce9cf0d%252Fpa%252FNE94103_668d4fe8d6c17866055549ccec97da32.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_668d4fe8d6c17866055549ccec97da32.jpg not downloaded yet
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_0c6a8ac2e2e955141f10bad286787606.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_0c6a8ac2e2e955141f10bad286787606.jpg not downloaded yet
2026-03-28 11:31:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42fe450>
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_527b4d0286ba9f2322fdea5182de333e.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_527b4d0286ba9f2322fdea5182de333e.jpg saved to cache
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43f12160-f078-597b-82c3-d3f29410dc70
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa432d0d0>
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_d2ea65b200bcbe019560aebf8ebb857b.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_d2ea65b200bcbe019560aebf8ebb857b.jpg saved to cache
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d17c10e0-e10f-521d-81c0-79a0f63ac5a0
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8a97ceee50>
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_cf6d2858ef4d4c9e6ad88ae6b6a716c6.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_cf6d2858ef4d4c9e6ad88ae6b6a716c6.jpg saved to cache
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acf55a91-a1a3-58c3-b51d-8ff5bea44810
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_b48d36eaac6489ca0b8ddfc9a43fb309.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_b48d36eaac6489ca0b8ddfc9a43fb309.jpg not downloaded yet
2026-03-28 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_5e81a65173e460abdde22cb05ec53f87.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_a456ebf77a89ddcaa371abdedc3f108e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_a21637224eed7fd6bd9d52d77fb10b57.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_f409752156c4f87a252ffe7fae338489.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_f409752156c4f87a252ffe7fae338489.jpg not downloaded yet
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa43e2950>
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_e4b02388fbe8135e0ce09343a09df38e.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_e4b02388fbe8135e0ce09343a09df38e.jpg saved to cache
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d17c10e0-e10f-521d-81c0-79a0f63ac5a0
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_ae620c1730c967c2d292a442fbe6506e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_ae620c1730c967c2d292a442fbe6506e.jpg not downloaded yet
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_d875c4c6abeacfc03d382a71305547e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_d875c4c6abeacfc03d382a71305547e4.jpg not downloaded yet
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4200850>
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_5e81a65173e460abdde22cb05ec53f87.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_5e81a65173e460abdde22cb05ec53f87.jpg saved to cache
2026-03-28 11:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 771730b6-0b82-5d01-8b53-b1a8ab9642af
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e32f90>
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_a456ebf77a89ddcaa371abdedc3f108e.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_a456ebf77a89ddcaa371abdedc3f108e.jpg saved to cache
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 771730b6-0b82-5d01-8b53-b1a8ab9642af
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8a97d20fd0>
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_a21637224eed7fd6bd9d52d77fb10b57.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_a21637224eed7fd6bd9d52d77fb10b57.jpg saved to cache
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43f12160-f078-597b-82c3-d3f29410dc70
2026-03-28 11:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_3be5ff4689d34bc4c3f939e6d43f3c6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_81e49a19436c0c0f976597ad7ad2b17d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_59ed92d43025eff3b8cec5c9b59d149d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_c70417aab972c63050cea2aa9bfdb614.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_edc4ffb30c1781aecbcff0535d97cee0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_ca0fadedb3c774af9a70163981992535.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_1bca98656c7545b16274b3023ab8d411.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_1b6dd40156361b4e49129a445cd62737.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_b48d36eaac6489ca0b8ddfc9a43fb309.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_668d4fe8d6c17866055549ccec97da32.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d51ad0>
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_3be5ff4689d34bc4c3f939e6d43f3c6e.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_3be5ff4689d34bc4c3f939e6d43f3c6e.jpg saved to cache
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d17c10e0-e10f-521d-81c0-79a0f63ac5a0
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa40f8850>
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_81e49a19436c0c0f976597ad7ad2b17d.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_81e49a19436c0c0f976597ad7ad2b17d.jpg saved to cache
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43f12160-f078-597b-82c3-d3f29410dc70
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e4d250>
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_59ed92d43025eff3b8cec5c9b59d149d.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_59ed92d43025eff3b8cec5c9b59d149d.jpg saved to cache
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 771730b6-0b82-5d01-8b53-b1a8ab9642af
2026-03-28 11:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4280fd0>
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb2%252F6bb20578fc19d32bc244569132f1bdbe%252Fpa%252FZJ26009_c70417aab972c63050cea2aa9bfdb614.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_c70417aab972c63050cea2aa9bfdb614.jpg saved to cache
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef856ef4-db6c-5637-9d07-afdae111ee37
2026-03-28 11:31:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef856ef4-db6c-5637-9d07-afdae111ee37, skipping ID generation
2026-03-28 11:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef856ef4-db6c-5637-9d07-afdae111ee37 with scrape type 1
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef856ef4-db6c-5637-9d07-afdae111ee37 sending to next pipeline
2026-03-28 11:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ef856ef4-db6c-5637-9d07-afdae111ee37, identifier: ZJ26009
2026-03-28 11:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa6c06990>
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F28%252Fe028c65052da68c00cc7c20dfb2f8308%252Fpa%252FLR36013_edc4ffb30c1781aecbcff0535d97cee0.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_edc4ffb30c1781aecbcff0535d97cee0.jpg saved to cache
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7851fcd-848f-552e-bb27-09862abc5ccc
2026-03-28 11:31:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7851fcd-848f-552e-bb27-09862abc5ccc, skipping ID generation
2026-03-28 11:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7851fcd-848f-552e-bb27-09862abc5ccc with scrape type 1
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7851fcd-848f-552e-bb27-09862abc5ccc sending to next pipeline
2026-03-28 11:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c7851fcd-848f-552e-bb27-09862abc5ccc, identifier: LR36013
2026-03-28 11:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa416a490>
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_ca0fadedb3c774af9a70163981992535.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_ca0fadedb3c774af9a70163981992535.jpg saved to cache
2026-03-28 11:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acf55a91-a1a3-58c3-b51d-8ff5bea44810
2026-03-28 11:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8a97cf3bd0>
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_1bca98656c7545b16274b3023ab8d411.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_1bca98656c7545b16274b3023ab8d411.jpg saved to cache
2026-03-28 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 771730b6-0b82-5d01-8b53-b1a8ab9642af
2026-03-28 11:31:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa419e410>
2026-03-28 11:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_1b6dd40156361b4e49129a445cd62737.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_1b6dd40156361b4e49129a445cd62737.jpg saved to cache
2026-03-28 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acf55a91-a1a3-58c3-b51d-8ff5bea44810
2026-03-28 11:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ef856ef4-db6c-5637-9d07-afdae111ee37 with identifier: ZJ26009
2026-03-28 11:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ef856ef4-db6c-5637-9d07-afdae111ee37 with identifier: ZJ26009
2026-03-28 11:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ef856ef4-db6c-5637-9d07-afdae111ee37 with identifier: ZJ26009 to the API
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_c70417aab972c63050cea2aa9bfdb614.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:42:15Z',
 'fuel_type': 'petrol',
 'id': 'ef856ef4-db6c-5637-9d07-afdae111ee37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ26009',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 35034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878505,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_49a88004f6a858eefef46db4a7c3b249.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_7e7c0baa6f06e929837a290d74ae6143.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2654973,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_56f4159fbda39d18afaea38464070edf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2899474,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_dc10cb7c2efed4385b8f4ab37e9e6718.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2586084,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_c70417aab972c63050cea2aa9bfdb614.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_e118a421fc84aae1c87b7c43bd4387b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_dbd735fb73039cfedef119144807775b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_bca42c63cfab6ca4be4f69be1c9125f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_d1bd990bd7f6d583aabdbcde443db120.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef856ef4-db6c-5637-9d07-afdae111ee37/ef856ef4-db6c-5637-9d07-afdae111ee37_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b2/6bb20578fc19d32bc244569132f1bdbe/pa/ZJ26009_077e7e933f9633f95a15f3e1ea8130c6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2021}
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26009%27 HTTP/1.1" 200 None
2026-03-28 11:31:29 [auto1.be] INFO: Saving data for ZJ26009: {'created_time': 1774697489.461663, 'last_price_update_time': 1774697489.461674, 'auction_closing_time': 1774885335.0}
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ26009') HTTP/1.1" 204 0
2026-03-28 11:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c7851fcd-848f-552e-bb27-09862abc5ccc with identifier: LR36013
2026-03-28 11:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c7851fcd-848f-552e-bb27-09862abc5ccc with identifier: LR36013
2026-03-28 11:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c7851fcd-848f-552e-bb27-09862abc5ccc with identifier: LR36013 to the API
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_edc4ffb30c1781aecbcff0535d97cee0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:45:31Z',
 'fuel_type': 'diesel',
 'id': 'c7851fcd-848f-552e-bb27-09862abc5ccc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR36013',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 184712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_70cc9f133efa16b96883d5257d9a191c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2984923,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_52d2a00f2da223c2b783ed0051d938a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_88bf20465719533ba7e3dc6394dc88ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2904795,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_edc4ffb30c1781aecbcff0535d97cee0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_e86d9df0cf131359f80bf287e2537003.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2823213,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_2bc7d872e2eba48e825ba1f95e48765c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_f41f7e23032e0475aba67f93593521d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2979264,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_7e07c67c2b7423c02f319900e30fca66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_716082c9f19f98f09cd012ca28a256d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7851fcd-848f-552e-bb27-09862abc5ccc/c7851fcd-848f-552e-bb27-09862abc5ccc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/28/e028c65052da68c00cc7c20dfb2f8308/pa/LR36013_6fa77fdd6a977bd95185631b73a47e19.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR36013%27 HTTP/1.1" 200 None
2026-03-28 11:31:29 [auto1.be] INFO: Saving data for LR36013: {'created_time': 1774697489.840527, 'last_price_update_time': 1774697489.84057, 'auction_closing_time': 1774885531.0}
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LR36013') HTTP/1.1" 204 0
2026-03-28 11:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_9ba9c20ebbe89948830c6afd91c7283a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_12e5127ad18aeb33d13d56a509c472e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_325b6bf5000c7d2242e52a998e8eca3f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8a97d23f50>
2026-03-28 11:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_b48d36eaac6489ca0b8ddfc9a43fb309.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_b48d36eaac6489ca0b8ddfc9a43fb309.jpg saved to cache
2026-03-28 11:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2
2026-03-28 11:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e287d0>
2026-03-28 11:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ad94f-670c-5b81-852b-8f1e7fab46ab/ed6ad94f-670c-5b81-852b-8f1e7fab46ab_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F82%252Fdd826a6818b137915f7d109f5ce9cf0d%252Fpa%252FNE94103_668d4fe8d6c17866055549ccec97da32.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_668d4fe8d6c17866055549ccec97da32.jpg saved to cache
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed6ad94f-670c-5b81-852b-8f1e7fab46ab
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa416ee90>
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_9ba9c20ebbe89948830c6afd91c7283a.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_9ba9c20ebbe89948830c6afd91c7283a.jpg saved to cache
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item acf55a91-a1a3-58c3-b51d-8ff5bea44810
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8a97d21c50>
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_12e5127ad18aeb33d13d56a509c472e7.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_12e5127ad18aeb33d13d56a509c472e7.jpg saved to cache
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acf55a91-a1a3-58c3-b51d-8ff5bea44810
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa423da90>
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_325b6bf5000c7d2242e52a998e8eca3f.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_325b6bf5000c7d2242e52a998e8eca3f.jpg saved to cache
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43f12160-f078-597b-82c3-d3f29410dc70
2026-03-28 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_f409752156c4f87a252ffe7fae338489.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_52978a0df0ff72d0612f56658cdb8a05.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_0c6a8ac2e2e955141f10bad286787606.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_d875c4c6abeacfc03d382a71305547e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_e3a5d8f76ecb6b52cc16f48469d1f7fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_ae620c1730c967c2d292a442fbe6506e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_e8d5e66c8ce71c2d94f9e696b4f9e1ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_b1c7caa93b22d86d45e6a86635229060.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_1a242d9ff566b065965665a0dac3bb57.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_1ae5591d31c89c5a5aa84c532ba05d7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa6ef5710>
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_f409752156c4f87a252ffe7fae338489.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_f409752156c4f87a252ffe7fae338489.jpg saved to cache
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2
2026-03-28 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_b52bab9c372b9c5dd890513ca83ae6cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa432f6d0>
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_52978a0df0ff72d0612f56658cdb8a05.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_52978a0df0ff72d0612f56658cdb8a05.jpg saved to cache
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2
2026-03-28 11:31:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa442e950>
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_0c6a8ac2e2e955141f10bad286787606.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_0c6a8ac2e2e955141f10bad286787606.jpg saved to cache
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2
2026-03-28 11:31:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d27510>
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_d875c4c6abeacfc03d382a71305547e4.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_d875c4c6abeacfc03d382a71305547e4.jpg saved to cache
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2
2026-03-28 11:31:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa414f850>
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_e3a5d8f76ecb6b52cc16f48469d1f7fd.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_e3a5d8f76ecb6b52cc16f48469d1f7fd.jpg saved to cache
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 771730b6-0b82-5d01-8b53-b1a8ab9642af
2026-03-28 11:31:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa419e650>
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_ae620c1730c967c2d292a442fbe6506e.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_ae620c1730c967c2d292a442fbe6506e.jpg saved to cache
2026-03-28 11:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2
2026-03-28 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_868882a9119692f5766c1c7e8a3e09af.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_85518007a1a67759a89fbf489d04dbd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa6c60110>
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_e8d5e66c8ce71c2d94f9e696b4f9e1ef.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_e8d5e66c8ce71c2d94f9e696b4f9e1ef.jpg saved to cache
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4129410>
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ad94f-670c-5b81-852b-8f1e7fab46ab/ed6ad94f-670c-5b81-852b-8f1e7fab46ab_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F82%252Fdd826a6818b137915f7d109f5ce9cf0d%252Fpa%252FNE94103_b1c7caa93b22d86d45e6a86635229060.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_b1c7caa93b22d86d45e6a86635229060.jpg saved to cache
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed6ad94f-670c-5b81-852b-8f1e7fab46ab
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4463bd0>
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ad94f-670c-5b81-852b-8f1e7fab46ab/ed6ad94f-670c-5b81-852b-8f1e7fab46ab_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F82%252Fdd826a6818b137915f7d109f5ce9cf0d%252Fpa%252FNE94103_1a242d9ff566b065965665a0dac3bb57.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_1a242d9ff566b065965665a0dac3bb57.jpg saved to cache
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed6ad94f-670c-5b81-852b-8f1e7fab46ab
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42c93d0>
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ad94f-670c-5b81-852b-8f1e7fab46ab/ed6ad94f-670c-5b81-852b-8f1e7fab46ab_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F82%252Fdd826a6818b137915f7d109f5ce9cf0d%252Fpa%252FNE94103_1ae5591d31c89c5a5aa84c532ba05d7c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_1ae5591d31c89c5a5aa84c532ba05d7c.jpg saved to cache
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed6ad94f-670c-5b81-852b-8f1e7fab46ab
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41abb10>
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ad94f-670c-5b81-852b-8f1e7fab46ab/ed6ad94f-670c-5b81-852b-8f1e7fab46ab_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F82%252Fdd826a6818b137915f7d109f5ce9cf0d%252Fpa%252FNE94103_b52bab9c372b9c5dd890513ca83ae6cc.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_b52bab9c372b9c5dd890513ca83ae6cc.jpg saved to cache
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed6ad94f-670c-5b81-852b-8f1e7fab46ab
2026-03-28 11:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_37e119479c1ed5d271f0a97fe757e690.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41d1450>
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed6ad94f-670c-5b81-852b-8f1e7fab46ab/ed6ad94f-670c-5b81-852b-8f1e7fab46ab_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F82%252Fdd826a6818b137915f7d109f5ce9cf0d%252Fpa%252FNE94103_868882a9119692f5766c1c7e8a3e09af.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_868882a9119692f5766c1c7e8a3e09af.jpg saved to cache
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed6ad94f-670c-5b81-852b-8f1e7fab46ab
2026-03-28 11:31:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed6ad94f-670c-5b81-852b-8f1e7fab46ab, skipping ID generation
2026-03-28 11:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed6ad94f-670c-5b81-852b-8f1e7fab46ab with scrape type 1
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed6ad94f-670c-5b81-852b-8f1e7fab46ab sending to next pipeline
2026-03-28 11:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ed6ad94f-670c-5b81-852b-8f1e7fab46ab, identifier: NE94103
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4427f50>
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_85518007a1a67759a89fbf489d04dbd5.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_85518007a1a67759a89fbf489d04dbd5.jpg saved to cache
2026-03-28 11:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43f12160-f078-597b-82c3-d3f29410dc70
2026-03-28 11:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ed6ad94f-670c-5b81-852b-8f1e7fab46ab with identifier: NE94103
2026-03-28 11:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ed6ad94f-670c-5b81-852b-8f1e7fab46ab with identifier: NE94103
2026-03-28 11:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ed6ad94f-670c-5b81-852b-8f1e7fab46ab with identifier: NE94103 to the API
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_868882a9119692f5766c1c7e8a3e09af.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.8L',
 'engine_horse_power': 260,
 'expiration_date': '2026-03-30T15:38:11Z',
 'fuel_type': 'petrol',
 'id': 'ed6ad94f-670c-5b81-852b-8f1e7fab46ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE94103',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 231348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed6ad94f-670c-5b81-852b-8f1e7fab46ab/ed6ad94f-670c-5b81-852b-8f1e7fab46ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_1ae5591d31c89c5a5aa84c532ba05d7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed6ad94f-670c-5b81-852b-8f1e7fab46ab/ed6ad94f-670c-5b81-852b-8f1e7fab46ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_b52bab9c372b9c5dd890513ca83ae6cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed6ad94f-670c-5b81-852b-8f1e7fab46ab/ed6ad94f-670c-5b81-852b-8f1e7fab46ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_1a242d9ff566b065965665a0dac3bb57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed6ad94f-670c-5b81-852b-8f1e7fab46ab/ed6ad94f-670c-5b81-852b-8f1e7fab46ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_868882a9119692f5766c1c7e8a3e09af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed6ad94f-670c-5b81-852b-8f1e7fab46ab/ed6ad94f-670c-5b81-852b-8f1e7fab46ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_b1c7caa93b22d86d45e6a86635229060.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed6ad94f-670c-5b81-852b-8f1e7fab46ab/ed6ad94f-670c-5b81-852b-8f1e7fab46ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/82/dd826a6818b137915f7d109f5ce9cf0d/pa/NE94103_668d4fe8d6c17866055549ccec97da32.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.8 V6 Turbo Innovation 4x4',
 'transmission': 'automatic',
 'trim': 'Innovation 4x4',
 'year': 2011}
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE94103%27 HTTP/1.1" 200 None
2026-03-28 11:31:32 [auto1.be] INFO: Saving data for NE94103: {'created_time': 1774697492.018195, 'last_price_update_time': 1774697492.018206, 'auction_closing_time': 1774885091.0}
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NE94103') HTTP/1.1" 204 0
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_225066336eaa6bf6f1a9da81e3b8cabc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_339d2c0dd69e586ba5516063d5191c4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_9cb4c94c0eccb997dfb9f1c1efdf9da7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW60531> (referer: https://www.auto1.com/v1/car-details-view/SW60531/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH65741> (referer: https://www.auto1.com/v1/car-details-view/KH65741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa44277d0>
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_37e119479c1ed5d271f0a97fe757e690.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_37e119479c1ed5d271f0a97fe757e690.jpg saved to cache
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acf55a91-a1a3-58c3-b51d-8ff5bea44810
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_483b3da2a0c70fb92b1d0edeb87b5d0c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_28c3cf770be70661cf33961244afc775.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_e96ad4c855d50706816c3c74ea1db63f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_dade59559329c29b2c4dc36a7e787db0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_e1edc3da789541bff87c3119726d72dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa40f71d0>
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_225066336eaa6bf6f1a9da81e3b8cabc.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_225066336eaa6bf6f1a9da81e3b8cabc.jpg saved to cache
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 771730b6-0b82-5d01-8b53-b1a8ab9642af
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4201950>
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F54%252F7354293ecc50df5e9883e3bd70171454%252Fpa%252FJU94491_339d2c0dd69e586ba5516063d5191c4d.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_339d2c0dd69e586ba5516063d5191c4d.jpg saved to cache
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acf55a91-a1a3-58c3-b51d-8ff5bea44810
2026-03-28 11:31:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acf55a91-a1a3-58c3-b51d-8ff5bea44810, skipping ID generation
2026-03-28 11:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acf55a91-a1a3-58c3-b51d-8ff5bea44810 with scrape type 1
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acf55a91-a1a3-58c3-b51d-8ff5bea44810 sending to next pipeline
2026-03-28 11:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: acf55a91-a1a3-58c3-b51d-8ff5bea44810, identifier: JU94491
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa6efe910>
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_9cb4c94c0eccb997dfb9f1c1efdf9da7.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_9cb4c94c0eccb997dfb9f1c1efdf9da7.jpg saved to cache
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43f12160-f078-597b-82c3-d3f29410dc70
2026-03-28 11:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aad36dce-515d-550b-8443-24c9c28ed4fc with identifier: SW60531
2026-03-28 11:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad36dce-515d-550b-8443-24c9c28ed4fc with scrape type 1
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aad36dce-515d-550b-8443-24c9c28ed4fc
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_5ca7cd79a62a61d57e7d4e0b7122f5c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_5ca7cd79a62a61d57e7d4e0b7122f5c0.jpg not downloaded yet
2026-03-28 11:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 651bb9bb-9b15-56ef-a72b-a707d51eb51f with identifier: KH65741
2026-03-28 11:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 651bb9bb-9b15-56ef-a72b-a707d51eb51f with scrape type 1
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 651bb9bb-9b15-56ef-a72b-a707d51eb51f
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F95%252Fae953f7c49147dd169c7850fdf0259db%252Fpa%252FKH65741_2f3d9004307882f8d233089a8be2845c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_2f3d9004307882f8d233089a8be2845c.jpg not downloaded yet
2026-03-28 11:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: acf55a91-a1a3-58c3-b51d-8ff5bea44810 with identifier: JU94491
2026-03-28 11:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: acf55a91-a1a3-58c3-b51d-8ff5bea44810 with identifier: JU94491
2026-03-28 11:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: acf55a91-a1a3-58c3-b51d-8ff5bea44810 with identifier: JU94491 to the API
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_339d2c0dd69e586ba5516063d5191c4d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:49:56Z',
 'fuel_type': 'diesel',
 'id': 'acf55a91-a1a3-58c3-b51d-8ff5bea44810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU94491',
 'listing': 'auction',
 'location': 'BE, Sint-Truiden',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 226297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_987caf2e3ecfaad978dfe6dac106839c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_db8a6c218533d4a5bdc6f56310f8ee5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_51e972ab79c0ab876e45e8003b034a2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_37e119479c1ed5d271f0a97fe757e690.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2350965,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_ca0fadedb3c774af9a70163981992535.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_cf6d2858ef4d4c9e6ad88ae6b6a716c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_1b6dd40156361b4e49129a445cd62737.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_339d2c0dd69e586ba5516063d5191c4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_12e5127ad18aeb33d13d56a509c472e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf55a91-a1a3-58c3-b51d-8ff5bea44810/acf55a91-a1a3-58c3-b51d-8ff5bea44810_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/54/7354293ecc50df5e9883e3bd70171454/pa/JU94491_9ba9c20ebbe89948830c6afd91c7283a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 200 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU94491%27 HTTP/1.1" 200 None
2026-03-28 11:31:32 [auto1.be] INFO: Saving data for JU94491: {'created_time': 1774697492.777255, 'last_price_update_time': 1774697492.777266, 'auction_closing_time': 1774885796.0}
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JU94491') HTTP/1.1" 204 0
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_5efb993322ab84a30eab86ed347b707f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_ce8e03fcfe27ada17a9bc8d769009d00.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_34f511558bc434ed2f4eac491035fa36.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_34f511558bc434ed2f4eac491035fa36.jpg not downloaded yet
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F95%252Fae953f7c49147dd169c7850fdf0259db%252Fpa%252FKH65741_253701ae49d948b939c31d8d9b2a285c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_253701ae49d948b939c31d8d9b2a285c.jpg not downloaded yet
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_b93743681907f19b1075a5161965c94b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_0e4bdeea8aae97f790c83e466ea0d9b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_7c279703b4c2270a996a5497a2d25801.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_7c279703b4c2270a996a5497a2d25801.jpg not downloaded yet
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F95%252Fae953f7c49147dd169c7850fdf0259db%252Fpa%252FKH65741_6543c3c855dd25dd154575206556be9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_6543c3c855dd25dd154575206556be9d.jpg not downloaded yet
2026-03-28 11:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa41f92d0>
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd5%252Fa7d502d237a4e9cf2ddd2155159d9cef%252Fpa%252FKB41449_483b3da2a0c70fb92b1d0edeb87b5d0c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_483b3da2a0c70fb92b1d0edeb87b5d0c.jpg saved to cache
2026-03-28 11:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43f12160-f078-597b-82c3-d3f29410dc70
2026-03-28 11:31:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43f12160-f078-597b-82c3-d3f29410dc70, skipping ID generation
2026-03-28 11:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43f12160-f078-597b-82c3-d3f29410dc70 with scrape type 1
2026-03-28 11:31:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43f12160-f078-597b-82c3-d3f29410dc70 sending to next pipeline
2026-03-28 11:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43f12160-f078-597b-82c3-d3f29410dc70, identifier: KB41449
2026-03-28 11:31:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4489810>
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_28c3cf770be70661cf33961244afc775.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_28c3cf770be70661cf33961244afc775.jpg saved to cache
2026-03-28 11:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2
2026-03-28 11:31:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa42b2610>
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_e96ad4c855d50706816c3c74ea1db63f.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_e96ad4c855d50706816c3c74ea1db63f.jpg saved to cache
2026-03-28 11:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2
2026-03-28 11:31:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4122550>
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fed%252Ffdedceb00539b4b1f79fa478ce05a3c8%252Fpa%252FCV58665_dade59559329c29b2c4dc36a7e787db0.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_dade59559329c29b2c4dc36a7e787db0.jpg saved to cache
2026-03-28 11:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2
2026-03-28 11:31:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2, skipping ID generation
2026-03-28 11:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2 with scrape type 1
2026-03-28 11:31:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2 sending to next pipeline
2026-03-28 11:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2, identifier: CV58665
2026-03-28 11:31:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa44a6d10>
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_e1edc3da789541bff87c3119726d72dd.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_e1edc3da789541bff87c3119726d72dd.jpg saved to cache
2026-03-28 11:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 771730b6-0b82-5d01-8b53-b1a8ab9642af
2026-03-28 11:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43f12160-f078-597b-82c3-d3f29410dc70 with identifier: KB41449
2026-03-28 11:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43f12160-f078-597b-82c3-d3f29410dc70 with identifier: KB41449
2026-03-28 11:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43f12160-f078-597b-82c3-d3f29410dc70 with identifier: KB41449 to the API
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_483b3da2a0c70fb92b1d0edeb87b5d0c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:27:46Z',
 'fuel_type': 'petrol',
 'id': '43f12160-f078-597b-82c3-d3f29410dc70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB41449',
 'listing': 'auction',
 'location': 'BE, Belgium',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 93997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_27ec13d832b10f4ca006b90ad1e6695f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_527b4d0286ba9f2322fdea5182de333e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_a4c449beef40cf7302c137e8cc67821d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_9cb4c94c0eccb997dfb9f1c1efdf9da7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_53c6dcfb5a5a85b576d06b6f0978ce8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_a21637224eed7fd6bd9d52d77fb10b57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_81e49a19436c0c0f976597ad7ad2b17d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_483b3da2a0c70fb92b1d0edeb87b5d0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_85518007a1a67759a89fbf489d04dbd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f12160-f078-597b-82c3-d3f29410dc70/43f12160-f078-597b-82c3-d3f29410dc70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d5/a7d502d237a4e9cf2ddd2155159d9cef/pa/KB41449_325b6bf5000c7d2242e52a998e8eca3f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2021}
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB41449%27 HTTP/1.1" 200 None
2026-03-28 11:31:34 [auto1.be] INFO: Saving data for KB41449: {'created_time': 1774697494.088767, 'last_price_update_time': 1774697494.088777, 'auction_closing_time': 1774884466.0}
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KB41449') HTTP/1.1" 204 0
2026-03-28 11:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2 with identifier: CV58665
2026-03-28 11:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2 with identifier: CV58665
2026-03-28 11:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2 with identifier: CV58665 to the API
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_dade59559329c29b2c4dc36a7e787db0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:46:03Z',
 'fuel_type': 'petrol',
 'id': '395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV58665',
 'listing': 'auction',
 'location': 'BE, Oostende',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 105434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2474114,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_28c3cf770be70661cf33961244afc775.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2502580,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_e96ad4c855d50706816c3c74ea1db63f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2311318,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_dade59559329c29b2c4dc36a7e787db0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370524,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_52978a0df0ff72d0612f56658cdb8a05.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_e8d5e66c8ce71c2d94f9e696b4f9e1ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2314301,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_0c6a8ac2e2e955141f10bad286787606.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542512,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_b48d36eaac6489ca0b8ddfc9a43fb309.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_f409752156c4f87a252ffe7fae338489.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2435760,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_ae620c1730c967c2d292a442fbe6506e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2/395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2349750,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/ed/fdedceb00539b4b1f79fa478ce05a3c8/pa/CV58665_d875c4c6abeacfc03d382a71305547e4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cabrio One',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV58665%27 HTTP/1.1" 200 None
2026-03-28 11:31:34 [auto1.be] INFO: Saving data for CV58665: {'created_time': 1774697494.488421, 'last_price_update_time': 1774697494.48845, 'auction_closing_time': 1774885563.0}
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CV58665') HTTP/1.1" 204 0
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_792a03ebf9d17f0d649c82a7e6e33fca.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_792a03ebf9d17f0d649c82a7e6e33fca.jpg not downloaded yet
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F95%252Fae953f7c49147dd169c7850fdf0259db%252Fpa%252FKH65741_02a98cae16bc2a252b30ef7812028405.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_02a98cae16bc2a252b30ef7812028405.jpg not downloaded yet
2026-03-28 11:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ51820> (referer: https://www.auto1.com/v1/car-details-view/JJ51820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa6efb690>
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_5efb993322ab84a30eab86ed347b707f.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_5efb993322ab84a30eab86ed347b707f.jpg saved to cache
2026-03-28 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d17c10e0-e10f-521d-81c0-79a0f63ac5a0
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d52010>
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fd3%252F4bd38c0cd7b46dcacf6a6c8ae40538cd%252Fpa%252FPU93740_ce8e03fcfe27ada17a9bc8d769009d00.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_ce8e03fcfe27ada17a9bc8d769009d00.jpg saved to cache
2026-03-28 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d17c10e0-e10f-521d-81c0-79a0f63ac5a0
2026-03-28 11:31:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d17c10e0-e10f-521d-81c0-79a0f63ac5a0, skipping ID generation
2026-03-28 11:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d17c10e0-e10f-521d-81c0-79a0f63ac5a0 with scrape type 1
2026-03-28 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d17c10e0-e10f-521d-81c0-79a0f63ac5a0 sending to next pipeline
2026-03-28 11:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d17c10e0-e10f-521d-81c0-79a0f63ac5a0, identifier: PU93740
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d26d50>
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_b93743681907f19b1075a5161965c94b.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_b93743681907f19b1075a5161965c94b.jpg saved to cache
2026-03-28 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 771730b6-0b82-5d01-8b53-b1a8ab9642af
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa412bad0>
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_0e4bdeea8aae97f790c83e466ea0d9b8.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_0e4bdeea8aae97f790c83e466ea0d9b8.jpg saved to cache
2026-03-28 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 771730b6-0b82-5d01-8b53-b1a8ab9642af
2026-03-28 11:31:34 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_6d60487b800ee091678a7d4ac8bbe953.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_6d60487b800ee091678a7d4ac8bbe953.jpg not downloaded yet
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F95%252Fae953f7c49147dd169c7850fdf0259db%252Fpa%252FKH65741_fd93fba32763d196116b173832797893.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_fd93fba32763d196116b173832797893.jpg not downloaded yet
2026-03-28 11:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d17c10e0-e10f-521d-81c0-79a0f63ac5a0 with identifier: PU93740
2026-03-28 11:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d17c10e0-e10f-521d-81c0-79a0f63ac5a0 with identifier: PU93740
2026-03-28 11:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d17c10e0-e10f-521d-81c0-79a0f63ac5a0 with identifier: PU93740 to the API
2026-03-28 11:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_ce8e03fcfe27ada17a9bc8d769009d00.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:57:51Z',
 'fuel_type': 'petrol',
 'id': 'd17c10e0-e10f-521d-81c0-79a0f63ac5a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU93740',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '1er',
 'odometer': 161164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_ce8e03fcfe27ada17a9bc8d769009d00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_a4f93641c82859ef2e1e74dd12a97c5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_eff177f1d94091c05ec37aa05568292b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_5efb993322ab84a30eab86ed347b707f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_d2ea65b200bcbe019560aebf8ebb857b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_e4b02388fbe8135e0ce09343a09df38e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_3be5ff4689d34bc4c3f939e6d43f3c6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2625249,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_39d3de45d06f557f5ad28195341e3e75.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2687451,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_9bf0d2f22afbc4cef769806a12c16544.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d17c10e0-e10f-521d-81c0-79a0f63ac5a0/d17c10e0-e10f-521d-81c0-79a0f63ac5a0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2616748,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/d3/4bd38c0cd7b46dcacf6a6c8ae40538cd/pa/PU93740_649e9abc7c33d26b6085448970b47d20.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU93740%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Saving data for PU93740: {'created_time': 1774697495.135218, 'last_price_update_time': 1774697495.135231, 'auction_closing_time': 1774886271.0}
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PU93740') HTTP/1.1" 204 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: HU32534
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU32534%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for HU32534: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for JS25395: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for TT75307: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: GB32239
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB32239%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for GB32239: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: SJ92859
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: RB55358
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: SL08078
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for SF38570: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: GF08223
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF08223%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for GF08223: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: PV92742
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV92742%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for PV92742: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: TE49722
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for TH53375: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for KG19380: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: WY74767
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY74767%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for WY74767: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for WA10715: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: PU36315
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: NN37079
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: WZ44217
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for XJ95743: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: EX12355
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX12355%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for EX12355: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: LB88275
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB88275%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for LB88275: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB29078%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for NB29078: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: NR75863
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: VC37293
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC37293%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for VC37293: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: GJ44725
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ44725%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for GJ44725: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: WW09549
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW09549%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for WW09549: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for VW32861: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: JT16310
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT16310%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for JT16310: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: KZ62896
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ62896%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for KZ62896: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: SP19111
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: PM94019
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM94019%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for PM94019: 0
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: BF62281
2026-03-28 11:31:35 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [auto1.be] INFO: Scrape type for YU72813: 0
2026-03-28 11:31:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_ba08d750fa92fb11ec89d925f28b5da3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_ba08d750fa92fb11ec89d925f28b5da3.jpg not downloaded yet
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F95%252Fae953f7c49147dd169c7850fdf0259db%252Fpa%252FKH65741_8bf13bb34d9ba3cc91900ebf6d086909.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_8bf13bb34d9ba3cc91900ebf6d086909.jpg not downloaded yet
2026-03-28 11:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 104696d1-0028-576f-9f9e-e905b7c8a95f with identifier: JJ51820
2026-03-28 11:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 104696d1-0028-576f-9f9e-e905b7c8a95f with scrape type 1
2026-03-28 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 104696d1-0028-576f-9f9e-e905b7c8a95f
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Faa%252Fd7aa9d827a296f00a56261dc1891589e%252Fpa%252FJJ51820_6981f35e4cb679eaf98845532c3942ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_6981f35e4cb679eaf98845532c3942ab.jpg already downloaded
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Faa%252Fd7aa9d827a296f00a56261dc1891589e%252Fpa%252FJJ51820_37c9ed2173ee97af1f7aec245efb8cb3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_37c9ed2173ee97af1f7aec245efb8cb3.jpg already downloaded
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Faa%252Fd7aa9d827a296f00a56261dc1891589e%252Fpa%252FJJ51820_aa390a69018d94f349b18c8b8fc5d2f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_aa390a69018d94f349b18c8b8fc5d2f9.jpg already downloaded
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Faa%252Fd7aa9d827a296f00a56261dc1891589e%252Fpa%252FJJ51820_d5ddbba5fd07366b1e160095654b40b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_d5ddbba5fd07366b1e160095654b40b3.jpg already downloaded
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Faa%252Fd7aa9d827a296f00a56261dc1891589e%252Fpa%252FJJ51820_8703b4f5ef81ca57946979054f6b7f81.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_8703b4f5ef81ca57946979054f6b7f81.jpg already downloaded
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Faa%252Fd7aa9d827a296f00a56261dc1891589e%252Fpa%252FJJ51820_d27b97ab5247637d52f326b8f7003713.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_d27b97ab5247637d52f326b8f7003713.jpg already downloaded
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Faa%252Fd7aa9d827a296f00a56261dc1891589e%252Fpa%252FJJ51820_22545217e08a9fb3f0ceed2f6f310307.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_22545217e08a9fb3f0ceed2f6f310307.jpg already downloaded
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Faa%252Fd7aa9d827a296f00a56261dc1891589e%252Fpa%252FJJ51820_43c45ab8aecfa6cd6a10838651fa4540.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_43c45ab8aecfa6cd6a10838651fa4540.jpg already downloaded
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Faa%252Fd7aa9d827a296f00a56261dc1891589e%252Fpa%252FJJ51820_7445bc5f5deedc9b80ef411bcc532a89.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_7445bc5f5deedc9b80ef411bcc532a89.jpg already downloaded
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Faa%252Fd7aa9d827a296f00a56261dc1891589e%252Fpa%252FJJ51820_9aafb012d7cb96f3e306545555561e59.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_9aafb012d7cb96f3e306545555561e59.jpg already downloaded
2026-03-28 11:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 104696d1-0028-576f-9f9e-e905b7c8a95f, identifier: JJ51820
2026-03-28 11:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 104696d1-0028-576f-9f9e-e905b7c8a95f with identifier: JJ51820
2026-03-28 11:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 104696d1-0028-576f-9f9e-e905b7c8a95f with identifier: JJ51820
2026-03-28 11:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 104696d1-0028-576f-9f9e-e905b7c8a95f with identifier: JJ51820 to the API
2026-03-28 11:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JJ51820>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:03:20Z',
 'fuel_type': 'petrol',
 'id': '104696d1-0028-576f-9f9e-e905b7c8a95f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ51820',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '5er',
 'odometer': 86542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_6981f35e4cb679eaf98845532c3942ab.jpg',
                'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_37c9ed2173ee97af1f7aec245efb8cb3.jpg',
                'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_aa390a69018d94f349b18c8b8fc5d2f9.jpg',
                'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_d5ddbba5fd07366b1e160095654b40b3.jpg',
                'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_8703b4f5ef81ca57946979054f6b7f81.jpg',
                'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_d27b97ab5247637d52f326b8f7003713.jpg',
                'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_22545217e08a9fb3f0ceed2f6f310307.jpg',
                'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_43c45ab8aecfa6cd6a10838651fa4540.jpg',
                'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_7445bc5f5deedc9b80ef411bcc532a89.jpg',
                'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_9aafb012d7cb96f3e306545555561e59.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_104696d1-0028-576f-9f9e-e905b7c8a95f/104696d1-0028-576f-9f9e-e905b7c8a95f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_6981f35e4cb679eaf98845532c3942ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_104696d1-0028-576f-9f9e-e905b7c8a95f/104696d1-0028-576f-9f9e-e905b7c8a95f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_37c9ed2173ee97af1f7aec245efb8cb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_104696d1-0028-576f-9f9e-e905b7c8a95f/104696d1-0028-576f-9f9e-e905b7c8a95f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_aa390a69018d94f349b18c8b8fc5d2f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_104696d1-0028-576f-9f9e-e905b7c8a95f/104696d1-0028-576f-9f9e-e905b7c8a95f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_d5ddbba5fd07366b1e160095654b40b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_104696d1-0028-576f-9f9e-e905b7c8a95f/104696d1-0028-576f-9f9e-e905b7c8a95f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_8703b4f5ef81ca57946979054f6b7f81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_104696d1-0028-576f-9f9e-e905b7c8a95f/104696d1-0028-576f-9f9e-e905b7c8a95f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_d27b97ab5247637d52f326b8f7003713.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_104696d1-0028-576f-9f9e-e905b7c8a95f/104696d1-0028-576f-9f9e-e905b7c8a95f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_22545217e08a9fb3f0ceed2f6f310307.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_104696d1-0028-576f-9f9e-e905b7c8a95f/104696d1-0028-576f-9f9e-e905b7c8a95f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_43c45ab8aecfa6cd6a10838651fa4540.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_104696d1-0028-576f-9f9e-e905b7c8a95f/104696d1-0028-576f-9f9e-e905b7c8a95f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_7445bc5f5deedc9b80ef411bcc532a89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_104696d1-0028-576f-9f9e-e905b7c8a95f/104696d1-0028-576f-9f9e-e905b7c8a95f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/aa/d7aa9d827a296f00a56261dc1891589e/pa/JJ51820_9aafb012d7cb96f3e306545555561e59.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530i xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ51820%27 HTTP/1.1" 200 None
2026-03-28 11:31:36 [auto1.be] INFO: Saving data for JJ51820: {'created_time': 1774697496.191657, 'last_price_update_time': 1774697496.191667, 'auction_closing_time': 1774883000.0}
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ51820') HTTP/1.1" 204 0
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_02a98cae16bc2a252b30ef7812028405.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_792a03ebf9d17f0d649c82a7e6e33fca.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_78327f73427f4c0beee81f7f0fa7c505.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_78327f73427f4c0beee81f7f0fa7c505.jpg not downloaded yet
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_253701ae49d948b939c31d8d9b2a285c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_2f3d9004307882f8d233089a8be2845c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_6543c3c855dd25dd154575206556be9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_7c279703b4c2270a996a5497a2d25801.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_34f511558bc434ed2f4eac491035fa36.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_88b82a0749f5c87662b347df0c7fe548.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_88b82a0749f5c87662b347df0c7fe548.jpg not downloaded yet
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_93a9be1f95763a4fa908ec0957a1dbac.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_93a9be1f95763a4fa908ec0957a1dbac.jpg not downloaded yet
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_f0c28f232981bcb6aad1b4dc816db0fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_f0c28f232981bcb6aad1b4dc816db0fa.jpg not downloaded yet
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_cd2bb4ae183077c1cda50b47a37fd9dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_fd93fba32763d196116b173832797893.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e04ed0>
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651bb9bb-9b15-56ef-a72b-a707d51eb51f/651bb9bb-9b15-56ef-a72b-a707d51eb51f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F95%252Fae953f7c49147dd169c7850fdf0259db%252Fpa%252FKH65741_02a98cae16bc2a252b30ef7812028405.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_02a98cae16bc2a252b30ef7812028405.jpg saved to cache
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 651bb9bb-9b15-56ef-a72b-a707d51eb51f
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_8bf13bb34d9ba3cc91900ebf6d086909.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_6d60487b800ee091678a7d4ac8bbe953.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_f0c28f232981bcb6aad1b4dc816db0fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e598d0>
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_792a03ebf9d17f0d649c82a7e6e33fca.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_792a03ebf9d17f0d649c82a7e6e33fca.jpg saved to cache
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aad36dce-515d-550b-8443-24c9c28ed4fc
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa443f190>
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651bb9bb-9b15-56ef-a72b-a707d51eb51f/651bb9bb-9b15-56ef-a72b-a707d51eb51f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F95%252Fae953f7c49147dd169c7850fdf0259db%252Fpa%252FKH65741_253701ae49d948b939c31d8d9b2a285c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_253701ae49d948b939c31d8d9b2a285c.jpg saved to cache
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 651bb9bb-9b15-56ef-a72b-a707d51eb51f
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa411b190>
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651bb9bb-9b15-56ef-a72b-a707d51eb51f/651bb9bb-9b15-56ef-a72b-a707d51eb51f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F95%252Fae953f7c49147dd169c7850fdf0259db%252Fpa%252FKH65741_2f3d9004307882f8d233089a8be2845c.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_2f3d9004307882f8d233089a8be2845c.jpg saved to cache
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 651bb9bb-9b15-56ef-a72b-a707d51eb51f
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4337990>
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651bb9bb-9b15-56ef-a72b-a707d51eb51f/651bb9bb-9b15-56ef-a72b-a707d51eb51f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F95%252Fae953f7c49147dd169c7850fdf0259db%252Fpa%252FKH65741_6543c3c855dd25dd154575206556be9d.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_6543c3c855dd25dd154575206556be9d.jpg saved to cache
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 651bb9bb-9b15-56ef-a72b-a707d51eb51f
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8a97d39750>
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_7c279703b4c2270a996a5497a2d25801.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_7c279703b4c2270a996a5497a2d25801.jpg saved to cache
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aad36dce-515d-550b-8443-24c9c28ed4fc
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa412a6d0>
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_34f511558bc434ed2f4eac491035fa36.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_34f511558bc434ed2f4eac491035fa36.jpg saved to cache
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aad36dce-515d-550b-8443-24c9c28ed4fc
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_93a9be1f95763a4fa908ec0957a1dbac.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_78327f73427f4c0beee81f7f0fa7c505.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_ba08d750fa92fb11ec89d925f28b5da3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_88b82a0749f5c87662b347df0c7fe548.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4d83890>
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bffe2d9ff1bd2d3a44a004a47738aa%252Fpa%252FRC51689_cd2bb4ae183077c1cda50b47a37fd9dc.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_cd2bb4ae183077c1cda50b47a37fd9dc.jpg saved to cache
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 771730b6-0b82-5d01-8b53-b1a8ab9642af
2026-03-28 11:31:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 771730b6-0b82-5d01-8b53-b1a8ab9642af, skipping ID generation
2026-03-28 11:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 771730b6-0b82-5d01-8b53-b1a8ab9642af with scrape type 1
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 771730b6-0b82-5d01-8b53-b1a8ab9642af sending to next pipeline
2026-03-28 11:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 771730b6-0b82-5d01-8b53-b1a8ab9642af, identifier: RC51689
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e3ba10>
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651bb9bb-9b15-56ef-a72b-a707d51eb51f/651bb9bb-9b15-56ef-a72b-a707d51eb51f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F95%252Fae953f7c49147dd169c7850fdf0259db%252Fpa%252FKH65741_fd93fba32763d196116b173832797893.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_fd93fba32763d196116b173832797893.jpg saved to cache
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 651bb9bb-9b15-56ef-a72b-a707d51eb51f
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e7c990>
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651bb9bb-9b15-56ef-a72b-a707d51eb51f/651bb9bb-9b15-56ef-a72b-a707d51eb51f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F95%252Fae953f7c49147dd169c7850fdf0259db%252Fpa%252FKH65741_8bf13bb34d9ba3cc91900ebf6d086909.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_8bf13bb34d9ba3cc91900ebf6d086909.jpg saved to cache
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 651bb9bb-9b15-56ef-a72b-a707d51eb51f
2026-03-28 11:31:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 651bb9bb-9b15-56ef-a72b-a707d51eb51f, skipping ID generation
2026-03-28 11:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 651bb9bb-9b15-56ef-a72b-a707d51eb51f with scrape type 1
2026-03-28 11:31:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 651bb9bb-9b15-56ef-a72b-a707d51eb51f sending to next pipeline
2026-03-28 11:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 651bb9bb-9b15-56ef-a72b-a707d51eb51f, identifier: KH65741
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4334150>
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_6d60487b800ee091678a7d4ac8bbe953.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_6d60487b800ee091678a7d4ac8bbe953.jpg saved to cache
2026-03-28 11:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aad36dce-515d-550b-8443-24c9c28ed4fc
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa443f990>
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_f0c28f232981bcb6aad1b4dc816db0fa.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_f0c28f232981bcb6aad1b4dc816db0fa.jpg saved to cache
2026-03-28 11:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aad36dce-515d-550b-8443-24c9c28ed4fc
2026-03-28 11:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 771730b6-0b82-5d01-8b53-b1a8ab9642af with identifier: RC51689
2026-03-28 11:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 771730b6-0b82-5d01-8b53-b1a8ab9642af with identifier: RC51689
2026-03-28 11:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 771730b6-0b82-5d01-8b53-b1a8ab9642af with identifier: RC51689 to the API
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_cd2bb4ae183077c1cda50b47a37fd9dc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:41:14Z',
 'fuel_type': 'petrol',
 'id': '771730b6-0b82-5d01-8b53-b1a8ab9642af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC51689',
 'listing': 'auction',
 'location': 'BE, Vilvoorde',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 108544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3254438,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_cd2bb4ae183077c1cda50b47a37fd9dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3241074,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_1bca98656c7545b16274b3023ab8d411.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_0e4bdeea8aae97f790c83e466ea0d9b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_b93743681907f19b1075a5161965c94b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_5e81a65173e460abdde22cb05ec53f87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_a456ebf77a89ddcaa371abdedc3f108e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_59ed92d43025eff3b8cec5c9b59d149d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_225066336eaa6bf6f1a9da81e3b8cabc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3178742,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_e1edc3da789541bff87c3119726d72dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771730b6-0b82-5d01-8b53-b1a8ab9642af/771730b6-0b82-5d01-8b53-b1a8ab9642af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2973511,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bffe2d9ff1bd2d3a44a004a47738aa/pa/RC51689_e3a5d8f76ecb6b52cc16f48469d1f7fd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A1 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC51689%27 HTTP/1.1" 200 None
2026-03-28 11:31:37 [auto1.be] INFO: Saving data for RC51689: {'created_time': 1774697497.530769, 'last_price_update_time': 1774697497.53078, 'auction_closing_time': 1774885274.0}
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RC51689') HTTP/1.1" 204 0
2026-03-28 11:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 651bb9bb-9b15-56ef-a72b-a707d51eb51f with identifier: KH65741
2026-03-28 11:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 651bb9bb-9b15-56ef-a72b-a707d51eb51f with identifier: KH65741
2026-03-28 11:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 651bb9bb-9b15-56ef-a72b-a707d51eb51f with identifier: KH65741 to the API
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_8bf13bb34d9ba3cc91900ebf6d086909.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:16:01Z',
 'fuel_type': 'petrol',
 'id': '651bb9bb-9b15-56ef-a72b-a707d51eb51f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH65741',
 'listing': 'auction',
 'location': 'BE, Herentals',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 73827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651bb9bb-9b15-56ef-a72b-a707d51eb51f/651bb9bb-9b15-56ef-a72b-a707d51eb51f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_2f3d9004307882f8d233089a8be2845c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651bb9bb-9b15-56ef-a72b-a707d51eb51f/651bb9bb-9b15-56ef-a72b-a707d51eb51f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_253701ae49d948b939c31d8d9b2a285c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651bb9bb-9b15-56ef-a72b-a707d51eb51f/651bb9bb-9b15-56ef-a72b-a707d51eb51f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_6543c3c855dd25dd154575206556be9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651bb9bb-9b15-56ef-a72b-a707d51eb51f/651bb9bb-9b15-56ef-a72b-a707d51eb51f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_02a98cae16bc2a252b30ef7812028405.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651bb9bb-9b15-56ef-a72b-a707d51eb51f/651bb9bb-9b15-56ef-a72b-a707d51eb51f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_fd93fba32763d196116b173832797893.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651bb9bb-9b15-56ef-a72b-a707d51eb51f/651bb9bb-9b15-56ef-a72b-a707d51eb51f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/95/ae953f7c49147dd169c7850fdf0259db/pa/KH65741_8bf13bb34d9ba3cc91900ebf6d086909.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 Active",
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH65741%27 HTTP/1.1" 200 None
2026-03-28 11:31:37 [auto1.be] INFO: Saving data for KH65741: {'created_time': 1774697497.908294, 'last_price_update_time': 1774697497.908303, 'auction_closing_time': 1774883761.0}
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KH65741') HTTP/1.1" 204 0
2026-03-28 11:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4e6be50>
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_93a9be1f95763a4fa908ec0957a1dbac.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_93a9be1f95763a4fa908ec0957a1dbac.jpg saved to cache
2026-03-28 11:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aad36dce-515d-550b-8443-24c9c28ed4fc
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8a97cecf90>
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_78327f73427f4c0beee81f7f0fa7c505.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_78327f73427f4c0beee81f7f0fa7c505.jpg saved to cache
2026-03-28 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aad36dce-515d-550b-8443-24c9c28ed4fc
2026-03-28 11:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa43ac7d0>
2026-03-28 11:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_ba08d750fa92fb11ec89d925f28b5da3.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_ba08d750fa92fb11ec89d925f28b5da3.jpg saved to cache
2026-03-28 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aad36dce-515d-550b-8443-24c9c28ed4fc
2026-03-28 11:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa441da10>
2026-03-28 11:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_88b82a0749f5c87662b347df0c7fe548.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_88b82a0749f5c87662b347df0c7fe548.jpg saved to cache
2026-03-28 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aad36dce-515d-550b-8443-24c9c28ed4fc
2026-03-28 11:31:38 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: KM06752
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: FY96081
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY96081%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for FY96081: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: CP72825
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP72825%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for CP72825: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: YF72267
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF72267%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for YF72267: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: KZ21578
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: PS35692
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS35692%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for PS35692: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: PJ29729
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: SL54877
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL54877%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for SL54877: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: ZY27857
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: NX65189
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for CN29269: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: NB01852
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB01852%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for NB01852: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD01441%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for KD01441: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: WN30379
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: JX70748
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX70748%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for JX70748: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for XD36076: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: MX12092
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX12092%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for MX12092: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: AX26323
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: TP88301
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP88301%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for TP88301: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: FA45415
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: DS89988
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for XV14848: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: HY85639
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: RP50395
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: VB86156
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB86156%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for VB86156: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: XM97787
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: HV83812
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HV83812%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for HV83812: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: TR57009
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: FV70837
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: TB39644
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for UM90025: 2
2026-03-28 11:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8f3efbc-4f27-59c7-b27c-6e57c5429c55 with identifier: UM90025
2026-03-28 11:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8f3efbc-4f27-59c7-b27c-6e57c5429c55 with scrape type 2
2026-03-28 11:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8f3efbc-4f27-59c7-b27c-6e57c5429c55 with scrape type 2
2026-03-28 11:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a8f3efbc-4f27-59c7-b27c-6e57c5429c55, identifier: UM90025
2026-03-28 11:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a8f3efbc-4f27-59c7-b27c-6e57c5429c55 with identifier: UM90025
2026-03-28 11:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a8f3efbc-4f27-59c7-b27c-6e57c5429c55 with identifier: UM90025
2026-03-28 11:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a8f3efbc-4f27-59c7-b27c-6e57c5429c55 with identifier: UM90025 to the API
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:42:19Z',
 'fuel_type': 'diesel',
 'id': 'a8f3efbc-4f27-59c7-b27c-6e57c5429c55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM90025',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 114490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-18',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI lang Ambiente',
 'transmission': 'automatic',
 'trim': 'lang Ambiente',
 'year': 2014}
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Saving data for UM90025: {'auction_closing_time': 1774716139.0, 'created_time': 1774125036.435699, 'last_price_update_time': 1774697498.777126}
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UM90025') HTTP/1.1" 204 0
2026-03-28 11:31:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-28 11:31:38 [auto1.be] INFO: Scrape type for WE68493: 0
2026-03-28 11:31:38 [auto1.be] INFO: Found listing with ID: KN95173
2026-03-28 11:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_5ca7cd79a62a61d57e7d4e0b7122f5c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:31:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8aa4266150>
2026-03-28 11:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fd8%252F94d85b2844c88c6c1775df674c9b36d6%252Fpa%252FSW60531_5ca7cd79a62a61d57e7d4e0b7122f5c0.jpg') HTTP/1.1" 204 0
2026-03-28 11:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_5ca7cd79a62a61d57e7d4e0b7122f5c0.jpg saved to cache
2026-03-28 11:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aad36dce-515d-550b-8443-24c9c28ed4fc
2026-03-28 11:31:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aad36dce-515d-550b-8443-24c9c28ed4fc, skipping ID generation
2026-03-28 11:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad36dce-515d-550b-8443-24c9c28ed4fc with scrape type 1
2026-03-28 11:31:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aad36dce-515d-550b-8443-24c9c28ed4fc sending to next pipeline
2026-03-28 11:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aad36dce-515d-550b-8443-24c9c28ed4fc, identifier: SW60531
2026-03-28 11:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aad36dce-515d-550b-8443-24c9c28ed4fc with identifier: SW60531
2026-03-28 11:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aad36dce-515d-550b-8443-24c9c28ed4fc with identifier: SW60531
2026-03-28 11:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aad36dce-515d-550b-8443-24c9c28ed4fc with identifier: SW60531 to the API
2026-03-28 11:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_5ca7cd79a62a61d57e7d4e0b7122f5c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:17Z',
 'fuel_type': 'diesel',
 'id': 'aad36dce-515d-550b-8443-24c9c28ed4fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW60531',
 'listing': 'auction',
 'location': 'BE, Wanze',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 140536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2553578,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_5ca7cd79a62a61d57e7d4e0b7122f5c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_34f511558bc434ed2f4eac491035fa36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_7c279703b4c2270a996a5497a2d25801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_792a03ebf9d17f0d649c82a7e6e33fca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_6d60487b800ee091678a7d4ac8bbe953.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_ba08d750fa92fb11ec89d925f28b5da3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_78327f73427f4c0beee81f7f0fa7c505.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_88b82a0749f5c87662b347df0c7fe548.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_93a9be1f95763a4fa908ec0957a1dbac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad36dce-515d-550b-8443-24c9c28ed4fc/aad36dce-515d-550b-8443-24c9c28ed4fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/d8/94d85b2844c88c6c1775df674c9b36d6/pa/SW60531_f0c28f232981bcb6aad1b4dc816db0fa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2018}
2026-03-28 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW60531%27 HTTP/1.1" 200 None
2026-03-28 11:31:39 [auto1.be] INFO: Saving data for SW60531: {'created_time': 1774697499.610529, 'last_price_update_time': 1774697499.610539, 'auction_closing_time': 1774885097.0}
2026-03-28 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW60531') HTTP/1.1" 204 0
2026-03-28 11:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:40 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP75874%27 HTTP/1.1" 200 None
2026-03-28 11:31:40 [auto1.be] INFO: Scrape type for VP75874: 0
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: TU34385
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: UT50756
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT50756%27 HTTP/1.1" 200 None
2026-03-28 11:31:40 [auto1.be] INFO: Scrape type for UT50756: 0
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: RB21597
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: ZM96172
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM96172%27 HTTP/1.1" 200 None
2026-03-28 11:31:40 [auto1.be] INFO: Scrape type for ZM96172: 0
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: DC36147
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: TP45390
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP45390%27 HTTP/1.1" 200 None
2026-03-28 11:31:40 [auto1.be] INFO: Scrape type for TP45390: 0
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: FS22519
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS22519%27 HTTP/1.1" 200 None
2026-03-28 11:31:40 [auto1.be] INFO: Scrape type for FS22519: 0
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM47313%27 HTTP/1.1" 200 None
2026-03-28 11:31:40 [auto1.be] INFO: Scrape type for PM47313: 0
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA19213%27 HTTP/1.1" 200 None
2026-03-28 11:31:40 [auto1.be] INFO: Scrape type for FA19213: 0
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: TV03405
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: SJ45947
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ45947%27 HTTP/1.1" 200 None
2026-03-28 11:31:40 [auto1.be] INFO: Scrape type for SJ45947: 0
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: PT93863
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-28 11:31:40 [auto1.be] INFO: Scrape type for DL13581: 0
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: UT96766
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: XM22406
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM22406%27 HTTP/1.1" 200 None
2026-03-28 11:31:40 [auto1.be] INFO: Scrape type for XM22406: 0
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF11904%27 HTTP/1.1" 200 None
2026-03-28 11:31:40 [auto1.be] INFO: Scrape type for XF11904: 0
2026-03-28 11:31:40 [auto1.be] INFO: Found listing with ID: WC57902
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC57902%27 HTTP/1.1" 200 None
2026-03-28 11:31:40 [auto1.be] INFO: Scrape type for WC57902: 2
2026-03-28 11:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10ba33c1-7978-5542-90ec-b87319c7ba7c with identifier: WC57902
2026-03-28 11:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10ba33c1-7978-5542-90ec-b87319c7ba7c with scrape type 2
2026-03-28 11:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10ba33c1-7978-5542-90ec-b87319c7ba7c with scrape type 2
2026-03-28 11:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 10ba33c1-7978-5542-90ec-b87319c7ba7c, identifier: WC57902
2026-03-28 11:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 10ba33c1-7978-5542-90ec-b87319c7ba7c with identifier: WC57902
2026-03-28 11:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 10ba33c1-7978-5542-90ec-b87319c7ba7c with identifier: WC57902
2026-03-28 11:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 10ba33c1-7978-5542-90ec-b87319c7ba7c with identifier: WC57902 to the API
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:59:15Z',
 'fuel_type': 'diesel',
 'id': '10ba33c1-7978-5542-90ec-b87319c7ba7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC57902',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 224276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang Avantgarde',
 'transmission': 'automatic',
 'trim': 'lang Avantgarde',
 'year': 2017}
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC57902%27 HTTP/1.1" 200 None
2026-03-28 11:31:40 [auto1.be] INFO: Saving data for WC57902: {'auction_closing_time': 1774717155.0, 'created_time': 1774513837.212533, 'last_price_update_time': 1774697500.984972}
2026-03-28 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC57902') HTTP/1.1" 204 0
2026-03-28 11:31:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: ER60484
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER60484%27 HTTP/1.1" 200 None
2026-03-28 11:31:41 [auto1.be] INFO: Scrape type for ER60484: 0
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: MB05626
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB05626%27 HTTP/1.1" 200 None
2026-03-28 11:31:41 [auto1.be] INFO: Scrape type for MB05626: 0
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: NF63760
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: TC10006
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC10006%27 HTTP/1.1" 200 None
2026-03-28 11:31:41 [auto1.be] INFO: Scrape type for TC10006: 0
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: HZ06807
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ06807%27 HTTP/1.1" 200 None
2026-03-28 11:31:41 [auto1.be] INFO: Scrape type for HZ06807: 0
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: HU32342
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: HB89666
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: TC70277
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC70277%27 HTTP/1.1" 200 None
2026-03-28 11:31:41 [auto1.be] INFO: Scrape type for TC70277: 0
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: RB45642
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB45642%27 HTTP/1.1" 200 None
2026-03-28 11:31:41 [auto1.be] INFO: Scrape type for RB45642: 0
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-28 11:31:41 [auto1.be] INFO: Scrape type for HE95946: 0
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: AD25511
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD25511%27 HTTP/1.1" 200 None
2026-03-28 11:31:41 [auto1.be] INFO: Scrape type for AD25511: 0
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15920%27 HTTP/1.1" 200 None
2026-03-28 11:31:41 [auto1.be] INFO: Scrape type for MB15920: 2
2026-03-28 11:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 511efb27-ef0a-5c95-8f0a-33a6989d0107 with identifier: MB15920
2026-03-28 11:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 511efb27-ef0a-5c95-8f0a-33a6989d0107 with scrape type 2
2026-03-28 11:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 511efb27-ef0a-5c95-8f0a-33a6989d0107 with scrape type 2
2026-03-28 11:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 511efb27-ef0a-5c95-8f0a-33a6989d0107, identifier: MB15920
2026-03-28 11:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 511efb27-ef0a-5c95-8f0a-33a6989d0107 with identifier: MB15920
2026-03-28 11:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 511efb27-ef0a-5c95-8f0a-33a6989d0107 with identifier: MB15920
2026-03-28 11:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 511efb27-ef0a-5c95-8f0a-33a6989d0107 with identifier: MB15920 to the API
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 201,
 'expiration_date': '2026-03-28T16:43:59Z',
 'fuel_type': 'diesel',
 'id': '511efb27-ef0a-5c95-8f0a-33a6989d0107',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB15920',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 130645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-01',
 'seller_name': None,
 'title': 'BMW 5er 520d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15920%27 HTTP/1.1" 200 None
2026-03-28 11:31:41 [auto1.be] INFO: Saving data for MB15920: {'auction_closing_time': 1774716239.0, 'created_time': 1774038774.784671, 'last_price_update_time': 1774697501.668633}
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MB15920') HTTP/1.1" 204 0
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: JD48468
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: MN54564
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN54564%27 HTTP/1.1" 200 None
2026-03-28 11:31:41 [auto1.be] INFO: Scrape type for MN54564: 0
2026-03-28 11:31:41 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-28 11:31:41 [auto1.be] INFO: Scrape type for CH83928: 0
2026-03-28 11:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:43 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: JR78742
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: AN55129
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN55129%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for AN55129: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: TK17368
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK17368%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for TK17368: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: VD47423
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD47423%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for VD47423: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: HH31888
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH31888%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for HH31888: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for KK24955: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for UA82763: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for RK42644: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: VE77274
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for MA06269: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for TS87931: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: AN88473
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: DD10151
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: TH59922
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: VF82058
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF82058%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for VF82058: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for FP68376: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: CZ74735
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: EC58285
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EC58285%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for EC58285: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for FT96499: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for EX63844: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for HH62001: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: UR73275
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR73275%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for UR73275: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for RF74485: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: ZM59718
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM59718%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for ZM59718: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: YZ90167
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT59149%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for HT59149: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: VS47672
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: BZ90658
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for FW88759: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: HN52312
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN52312%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for HN52312: 0
2026-03-28 11:31:43 [auto1.be] INFO: Found listing with ID: CA69556
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA69556%27 HTTP/1.1" 200 None
2026-03-28 11:31:43 [auto1.be] INFO: Scrape type for CA69556: 0
2026-03-28 11:31:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:44 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:44 [auto1.be] INFO: Found listing with ID: BP57356
2026-03-28 11:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP57356%27 HTTP/1.1" 200 None
2026-03-28 11:31:44 [auto1.be] INFO: Scrape type for BP57356: 0
2026-03-28 11:31:44 [auto1.be] INFO: Found listing with ID: JZ31869
2026-03-28 11:31:44 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-28 11:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-28 11:31:44 [auto1.be] INFO: Scrape type for ZG73435: 2
2026-03-28 11:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58 with identifier: ZG73435
2026-03-28 11:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58 with scrape type 2
2026-03-28 11:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58 with scrape type 2
2026-03-28 11:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58, identifier: ZG73435
2026-03-28 11:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58 with identifier: ZG73435
2026-03-28 11:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58 with identifier: ZG73435
2026-03-28 11:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58 with identifier: ZG73435 to the API
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:53:26Z',
 'fuel_type': 'diesel',
 'id': '39ac1679-cb3e-5b5f-8e00-4b103f8b9b58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG73435',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 238491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-22',
 'seller_name': None,
 'title': 'BMW 7er 730d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-28 11:31:45 [auto1.be] INFO: Saving data for ZG73435: {'auction_closing_time': 1774716806.0, 'created_time': 1774513854.690711, 'last_price_update_time': 1774697505.279802}
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZG73435') HTTP/1.1" 204 0
2026-03-28 11:31:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:45 [auto1.be] INFO: Found listing with ID: YK49914
2026-03-28 11:31:45 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-28 11:31:45 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-28 11:31:45 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-28 11:31:45 [auto1.be] INFO: Found listing with ID: ET01802
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET01802%27 HTTP/1.1" 200 None
2026-03-28 11:31:45 [auto1.be] INFO: Scrape type for ET01802: 0
2026-03-28 11:31:45 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-28 11:31:45 [auto1.be] INFO: Found listing with ID: SD53912
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD53912%27 HTTP/1.1" 200 None
2026-03-28 11:31:45 [auto1.be] INFO: Scrape type for SD53912: 0
2026-03-28 11:31:45 [auto1.be] INFO: Found listing with ID: GC32489
2026-03-28 11:31:45 [auto1.be] INFO: Found listing with ID: YW10235
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW10235%27 HTTP/1.1" 200 None
2026-03-28 11:31:45 [auto1.be] INFO: Scrape type for YW10235: 0
2026-03-28 11:31:45 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-28 11:31:45 [auto1.be] INFO: Found listing with ID: WP70532
2026-03-28 11:31:45 [auto1.be] INFO: Found listing with ID: AN69845
2026-03-28 11:31:45 [auto1.be] INFO: Found listing with ID: MS53866
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS53866%27 HTTP/1.1" 200 None
2026-03-28 11:31:45 [auto1.be] INFO: Scrape type for MS53866: 2
2026-03-28 11:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47dc49d5-2df3-58d3-af87-f21d1da71af0 with identifier: MS53866
2026-03-28 11:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47dc49d5-2df3-58d3-af87-f21d1da71af0 with scrape type 2
2026-03-28 11:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47dc49d5-2df3-58d3-af87-f21d1da71af0 with scrape type 2
2026-03-28 11:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 47dc49d5-2df3-58d3-af87-f21d1da71af0, identifier: MS53866
2026-03-28 11:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 47dc49d5-2df3-58d3-af87-f21d1da71af0 with identifier: MS53866
2026-03-28 11:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 47dc49d5-2df3-58d3-af87-f21d1da71af0 with identifier: MS53866
2026-03-28 11:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 47dc49d5-2df3-58d3-af87-f21d1da71af0 with identifier: MS53866 to the API
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 99,
 'expiration_date': '2026-03-28T16:49:44Z',
 'fuel_type': 'diesel',
 'id': '47dc49d5-2df3-58d3-af87-f21d1da71af0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS53866',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 37025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-22',
 'seller_name': None,
 'title': 'Opel Combo 1.6 CDTI Express',
 'transmission': 'manual',
 'trim': 'Express',
 'year': 2019}
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS53866%27 HTTP/1.1" 200 None
2026-03-28 11:31:45 [auto1.be] INFO: Saving data for MS53866: {'auction_closing_time': 1774716584.0, 'created_time': 1774513853.476194, 'last_price_update_time': 1774697505.93737}
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MS53866') HTTP/1.1" 204 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: WG15817
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG15817%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for WG15817: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: JA16064
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA16064%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for JA16064: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: JU85415
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU85415%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for JU85415: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: BF20284
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF20284%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for BF20284: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: BY76075
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY76075%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for BY76075: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE43146%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for UE43146: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for MU18005: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for NG50909: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: JT25813
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT25813%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for JT25813: 2
2026-03-28 11:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a79472f-f7a1-5632-8378-a19bc0128a7d with identifier: JT25813
2026-03-28 11:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a79472f-f7a1-5632-8378-a19bc0128a7d with scrape type 2
2026-03-28 11:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a79472f-f7a1-5632-8378-a19bc0128a7d with scrape type 2
2026-03-28 11:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a79472f-f7a1-5632-8378-a19bc0128a7d, identifier: JT25813
2026-03-28 11:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a79472f-f7a1-5632-8378-a19bc0128a7d with identifier: JT25813
2026-03-28 11:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a79472f-f7a1-5632-8378-a19bc0128a7d with identifier: JT25813
2026-03-28 11:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a79472f-f7a1-5632-8378-a19bc0128a7d with identifier: JT25813 to the API
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:53:29Z',
 'fuel_type': 'petrol',
 'id': '5a79472f-f7a1-5632-8378-a19bc0128a7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT25813',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 187060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-19',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 VTi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT25813%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Saving data for JT25813: {'auction_closing_time': 1774716809.0, 'created_time': 1773822660.859769, 'last_price_update_time': 1774697506.729971}
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JT25813') HTTP/1.1" 204 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for LE58292: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: TV14945
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV14945%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for TV14945: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for WE56106: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for RW49064: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: AH50870
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: TF91319
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for ZP07177: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: KS30497
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: WJ28865
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ28865%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for WJ28865: 0
2026-03-28 11:31:46 [auto1.be] INFO: Found listing with ID: SA78346
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA78346%27 HTTP/1.1" 200 None
2026-03-28 11:31:46 [auto1.be] INFO: Scrape type for SA78346: 2
2026-03-28 11:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff3744fb-2320-5197-9897-74212f90f7f2 with identifier: SA78346
2026-03-28 11:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff3744fb-2320-5197-9897-74212f90f7f2 with scrape type 2
2026-03-28 11:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff3744fb-2320-5197-9897-74212f90f7f2 with scrape type 2
2026-03-28 11:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ff3744fb-2320-5197-9897-74212f90f7f2, identifier: SA78346
2026-03-28 11:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ff3744fb-2320-5197-9897-74212f90f7f2 with identifier: SA78346
2026-03-28 11:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ff3744fb-2320-5197-9897-74212f90f7f2 with identifier: SA78346
2026-03-28 11:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ff3744fb-2320-5197-9897-74212f90f7f2 with identifier: SA78346 to the API
2026-03-28 11:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-28T16:07:29Z',
 'fuel_type': 'hybrid',
 'id': 'ff3744fb-2320-5197-9897-74212f90f7f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA78346',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 174736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA78346%27 HTTP/1.1" 200 None
2026-03-28 11:31:47 [auto1.be] INFO: Saving data for SA78346: {'auction_closing_time': 1774714049.0, 'created_time': 1774513841.185569, 'last_price_update_time': 1774697507.251677}
2026-03-28 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SA78346') HTTP/1.1" 204 0
2026-03-28 11:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:48 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: HB59251
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59251%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for HB59251: 2
2026-03-28 11:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d254724e-628b-573c-8991-9e66fad68707 with identifier: HB59251
2026-03-28 11:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d254724e-628b-573c-8991-9e66fad68707 with scrape type 2
2026-03-28 11:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d254724e-628b-573c-8991-9e66fad68707 with scrape type 2
2026-03-28 11:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d254724e-628b-573c-8991-9e66fad68707, identifier: HB59251
2026-03-28 11:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d254724e-628b-573c-8991-9e66fad68707 with identifier: HB59251
2026-03-28 11:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d254724e-628b-573c-8991-9e66fad68707 with identifier: HB59251
2026-03-28 11:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d254724e-628b-573c-8991-9e66fad68707 with identifier: HB59251 to the API
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:26:14Z',
 'fuel_type': 'diesel',
 'id': 'd254724e-628b-573c-8991-9e66fad68707',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB59251',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 185140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-07',
 'seller_name': None,
 'title': 'Citroen C3 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2010}
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59251%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Saving data for HB59251: {'auction_closing_time': 1774715174.0, 'created_time': 1774513843.509082, 'last_price_update_time': 1774697508.678801}
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HB59251') HTTP/1.1" 204 0
2026-03-28 11:31:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: GU08447
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: SE01545
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: YS62292
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS62292%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for YS62292: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: JF05397
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for GG74067: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: PZ19137
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ19137%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for PZ19137: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: ZV64637
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: JS12412
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: YW35122
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: VP65458
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: BU16802
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU16802%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for BU16802: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: XK31036
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for CS98471: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for RB53949: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: LB84163
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB84163%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for LB84163: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: XG51748
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG51748%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for XG51748: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: TH69152
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: UM09750
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: WP96232
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP96232%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for WP96232: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: XP29569
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP29569%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for XP29569: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: KM78271
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for HS59761: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD69002%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for SD69002: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for RK05604: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for XZ27909: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: ET07668
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for CS90165: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: WE24792
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: SP41494
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: YA31821
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-28 11:31:48 [auto1.be] INFO: Scrape type for GA09150: 0
2026-03-28 11:31:48 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-28 11:31:49 [auto1.be] INFO: Scrape type for XC10139: 0
2026-03-28 11:31:49 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-28 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-28 11:31:49 [auto1.be] INFO: Scrape type for DF44974: 0
2026-03-28 11:31:49 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-28 11:31:49 [auto1.be] INFO: Found listing with ID: SD62634
2026-03-28 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD62634%27 HTTP/1.1" 200 None
2026-03-28 11:31:49 [auto1.be] INFO: Scrape type for SD62634: 0
2026-03-28 11:31:49 [auto1.be] INFO: Found listing with ID: FP33108
2026-03-28 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP33108%27 HTTP/1.1" 200 None
2026-03-28 11:31:49 [auto1.be] INFO: Scrape type for FP33108: 0
2026-03-28 11:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:50 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:50 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-28 11:31:50 [auto1.be] INFO: Scrape type for GS48835: 0
2026-03-28 11:31:50 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-28 11:31:50 [auto1.be] INFO: Scrape type for JM27578: 2
2026-03-28 11:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3f966b3-3618-5eb1-88ca-8d030aafe5bc with identifier: JM27578
2026-03-28 11:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3f966b3-3618-5eb1-88ca-8d030aafe5bc with scrape type 2
2026-03-28 11:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3f966b3-3618-5eb1-88ca-8d030aafe5bc with scrape type 2
2026-03-28 11:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a3f966b3-3618-5eb1-88ca-8d030aafe5bc, identifier: JM27578
2026-03-28 11:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a3f966b3-3618-5eb1-88ca-8d030aafe5bc with identifier: JM27578
2026-03-28 11:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a3f966b3-3618-5eb1-88ca-8d030aafe5bc with identifier: JM27578
2026-03-28 11:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a3f966b3-3618-5eb1-88ca-8d030aafe5bc with identifier: JM27578 to the API
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 144,
 'expiration_date': '2026-03-28T16:13:57Z',
 'fuel_type': 'diesel',
 'id': 'a3f966b3-3618-5eb1-88ca-8d030aafe5bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM27578',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 229998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 2.0 D-4D L1 Family',
 'transmission': 'automatic',
 'trim': 'L1 Family',
 'year': 2022}
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-28 11:31:50 [auto1.be] INFO: Saving data for JM27578: {'auction_closing_time': 1774714437.0, 'created_time': 1774513838.700189, 'last_price_update_time': 1774697510.712834}
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JM27578') HTTP/1.1" 204 0
2026-03-28 11:31:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:50 [auto1.be] INFO: Found listing with ID: MS83423
2026-03-28 11:31:50 [auto1.be] INFO: Found listing with ID: RM99520
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM99520%27 HTTP/1.1" 200 None
2026-03-28 11:31:50 [auto1.be] INFO: Scrape type for RM99520: 0
2026-03-28 11:31:50 [auto1.be] INFO: Found listing with ID: CY81530
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY81530%27 HTTP/1.1" 200 None
2026-03-28 11:31:50 [auto1.be] INFO: Scrape type for CY81530: 0
2026-03-28 11:31:50 [auto1.be] INFO: Found listing with ID: RJ35563
2026-03-28 11:31:50 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-28 11:31:50 [auto1.be] INFO: Scrape type for HP15544: 0
2026-03-28 11:31:50 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-28 11:31:50 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-28 11:31:50 [auto1.be] INFO: Scrape type for TX85632: 0
2026-03-28 11:31:50 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-28 11:31:50 [auto1.be] INFO: Found listing with ID: VY02593
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY02593%27 HTTP/1.1" 200 None
2026-03-28 11:31:50 [auto1.be] INFO: Scrape type for VY02593: 0
2026-03-28 11:31:50 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-28 11:31:50 [auto1.be] INFO: Scrape type for LW74134: 2
2026-03-28 11:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 897afe7f-048a-5c1b-9083-014581bddd00 with identifier: LW74134
2026-03-28 11:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 897afe7f-048a-5c1b-9083-014581bddd00 with scrape type 2
2026-03-28 11:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 897afe7f-048a-5c1b-9083-014581bddd00 with scrape type 2
2026-03-28 11:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 897afe7f-048a-5c1b-9083-014581bddd00, identifier: LW74134
2026-03-28 11:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 897afe7f-048a-5c1b-9083-014581bddd00 with identifier: LW74134
2026-03-28 11:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 897afe7f-048a-5c1b-9083-014581bddd00 with identifier: LW74134
2026-03-28 11:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 897afe7f-048a-5c1b-9083-014581bddd00 with identifier: LW74134 to the API
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:42:10Z',
 'fuel_type': 'petrol',
 'id': '897afe7f-048a-5c1b-9083-014581bddd00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW74134',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 102910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-15',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Saving data for LW74134: {'auction_closing_time': 1774716130.0, 'created_time': 1774125072.905653, 'last_price_update_time': 1774697511.318319}
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LW74134') HTTP/1.1" 204 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: KW54495
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: HK96372
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK96372%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for HK96372: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for AK54797: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: SN36947
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN36947%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for SN36947: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW33850%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for WW33850: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: EW19960
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for YS48127: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: VL30706
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: DT44813
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA83535%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for NA83535: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for RW15578: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: MR56300
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR56300%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for MR56300: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for BN63741: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: GS77634
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: NH29158
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: DY53822
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: TX50004
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50004%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for TX50004: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: FK81343
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK81343%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for FK81343: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for ZC67013: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: RA35148
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: GF59002
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for WC10504: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: VF97683
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF97683%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for VF97683: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: RZ67143
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ67143%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for RZ67143: 0
2026-03-28 11:31:51 [auto1.be] INFO: Found listing with ID: FL89669
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL89669%27 HTTP/1.1" 200 None
2026-03-28 11:31:51 [auto1.be] INFO: Scrape type for FL89669: 0
2026-03-28 11:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:52 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:52 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-28 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ68089%27 HTTP/1.1" 200 None
2026-03-28 11:31:52 [auto1.be] INFO: Scrape type for HJ68089: 0
2026-03-28 11:31:52 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-28 11:31:52 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-28 11:31:52 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-28 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-28 11:31:52 [auto1.be] INFO: Scrape type for ZH14429: 0
2026-03-28 11:31:52 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-28 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-28 11:31:52 [auto1.be] INFO: Scrape type for RF80171: 2
2026-03-28 11:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb740380-c5f8-5999-9531-3b7739e0e236 with identifier: RF80171
2026-03-28 11:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb740380-c5f8-5999-9531-3b7739e0e236 with scrape type 2
2026-03-28 11:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb740380-c5f8-5999-9531-3b7739e0e236 with scrape type 2
2026-03-28 11:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fb740380-c5f8-5999-9531-3b7739e0e236, identifier: RF80171
2026-03-28 11:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fb740380-c5f8-5999-9531-3b7739e0e236 with identifier: RF80171
2026-03-28 11:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fb740380-c5f8-5999-9531-3b7739e0e236 with identifier: RF80171
2026-03-28 11:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fb740380-c5f8-5999-9531-3b7739e0e236 with identifier: RF80171 to the API
2026-03-28 11:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:23:09Z',
 'fuel_type': 'petrol',
 'id': 'fb740380-c5f8-5999-9531-3b7739e0e236',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF80171',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 110082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-07-05',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.3 1300',
 'transmission': 'manual',
 'trim': '1300',
 'year': 2000}
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Saving data for RF80171: {'auction_closing_time': 1774714989.0, 'created_time': 1774038862.293336, 'last_price_update_time': 1774697513.07509}
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RF80171') HTTP/1.1" 204 0
2026-03-28 11:31:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: EB43323
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS70949%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for MS70949: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: US70780
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US70780%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for US70780: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: LE21271
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE21271%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for LE21271: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: LL17745
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL17745%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for LL17745: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: JH06099
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for GG92230: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: WJ27954
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: CM55843
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM55843%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for CM55843: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: AA14466
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA14466%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for AA14466: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: JS61863
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS61863%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for JS61863: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: TR58381
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: WM08929
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: HJ85146
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ85146%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for HJ85146: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: HS04385
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for RH88749: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: YN50786
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: CM09652
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: CB51818
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB51818%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for CB51818: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: CH75684
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH75684%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for CH75684: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for XR84470: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: TL97420
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: WP12382
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP12382%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for WP12382: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for CS46874: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: YC89583
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC89583%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for YC89583: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for SU72836: 0
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: GS05336
2026-03-28 11:31:53 [auto1.be] INFO: Found listing with ID: XB71990
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB71990%27 HTTP/1.1" 200 None
2026-03-28 11:31:53 [auto1.be] INFO: Scrape type for XB71990: 0
2026-03-28 11:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:54 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:54 [auto1.be] INFO: Found listing with ID: JE75068
2026-03-28 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE75068%27 HTTP/1.1" 200 None
2026-03-28 11:31:54 [auto1.be] INFO: Scrape type for JE75068: 2
2026-03-28 11:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88a29390-ee0f-5afc-88a0-800d48c96aeb with identifier: JE75068
2026-03-28 11:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88a29390-ee0f-5afc-88a0-800d48c96aeb with scrape type 2
2026-03-28 11:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88a29390-ee0f-5afc-88a0-800d48c96aeb with scrape type 2
2026-03-28 11:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 88a29390-ee0f-5afc-88a0-800d48c96aeb, identifier: JE75068
2026-03-28 11:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 88a29390-ee0f-5afc-88a0-800d48c96aeb with identifier: JE75068
2026-03-28 11:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 88a29390-ee0f-5afc-88a0-800d48c96aeb with identifier: JE75068
2026-03-28 11:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 88a29390-ee0f-5afc-88a0-800d48c96aeb with identifier: JE75068 to the API
2026-03-28 11:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:33:59Z',
 'fuel_type': 'diesel',
 'id': '88a29390-ee0f-5afc-88a0-800d48c96aeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE75068',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 179185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-11',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE75068%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Saving data for JE75068: {'auction_closing_time': 1774715639.0, 'created_time': 1774513838.271809, 'last_price_update_time': 1774697515.01728}
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JE75068') HTTP/1.1" 204 0
2026-03-28 11:31:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: JU70188
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: EB16456
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB16456%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for EB16456: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for DW89258: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: EU07402
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU07402%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for EU07402: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: YK96520
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK96520%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for YK96520: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: UJ88717
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ88717%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for UJ88717: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for LK29098: 2
2026-03-28 11:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4993b87a-8fcb-588a-8851-04301e638bf8 with identifier: LK29098
2026-03-28 11:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4993b87a-8fcb-588a-8851-04301e638bf8 with scrape type 2
2026-03-28 11:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4993b87a-8fcb-588a-8851-04301e638bf8 with scrape type 2
2026-03-28 11:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4993b87a-8fcb-588a-8851-04301e638bf8, identifier: LK29098
2026-03-28 11:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4993b87a-8fcb-588a-8851-04301e638bf8 with identifier: LK29098
2026-03-28 11:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4993b87a-8fcb-588a-8851-04301e638bf8 with identifier: LK29098
2026-03-28 11:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4993b87a-8fcb-588a-8851-04301e638bf8 with identifier: LK29098 to the API
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:48:35Z',
 'fuel_type': 'diesel',
 'id': '4993b87a-8fcb-588a-8851-04301e638bf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK29098',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 160147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-25',
 'seller_name': None,
 'title': 'Opel Mokka 1.7 CDTI Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2013}
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Saving data for LK29098: {'auction_closing_time': 1774716515.0, 'created_time': 1773237983.79297, 'last_price_update_time': 1774697515.61987}
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK29098') HTTP/1.1" 204 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for UV91092: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: TT89669
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT89669%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for TT89669: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for CF04837: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: RK84429
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: DK31159
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: CP91867
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91867%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for CP91867: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for GR78986: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: DV43116
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV43116%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for DV43116: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: UA36562
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36562%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for UA36562: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for KV94769: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for NS73936: 0
2026-03-28 11:31:55 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-28 11:31:55 [auto1.be] INFO: Scrape type for DU38710: 2
2026-03-28 11:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af436cdf-cb97-5473-ae30-551f2541e4ea with identifier: DU38710
2026-03-28 11:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af436cdf-cb97-5473-ae30-551f2541e4ea with scrape type 2
2026-03-28 11:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af436cdf-cb97-5473-ae30-551f2541e4ea with scrape type 2
2026-03-28 11:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: af436cdf-cb97-5473-ae30-551f2541e4ea, identifier: DU38710
2026-03-28 11:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: af436cdf-cb97-5473-ae30-551f2541e4ea with identifier: DU38710
2026-03-28 11:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: af436cdf-cb97-5473-ae30-551f2541e4ea with identifier: DU38710
2026-03-28 11:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: af436cdf-cb97-5473-ae30-551f2541e4ea with identifier: DU38710 to the API
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:09:13Z',
 'fuel_type': 'petrol',
 'id': 'af436cdf-cb97-5473-ae30-551f2541e4ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU38710',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 130042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-17',
 'seller_name': None,
 'title': 'Peugeot 206+ 1.1 Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2010}
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-28 11:31:56 [auto1.be] INFO: Saving data for DU38710: {'auction_closing_time': 1774714153.0, 'created_time': 1774513852.99087, 'last_price_update_time': 1774697516.213909}
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DU38710') HTTP/1.1" 204 0
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: CF07146
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF07146%27 HTTP/1.1" 200 None
2026-03-28 11:31:56 [auto1.be] INFO: Scrape type for CF07146: 0
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: MU76581
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: GJ15610
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ15610%27 HTTP/1.1" 200 None
2026-03-28 11:31:56 [auto1.be] INFO: Scrape type for GJ15610: 0
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: MG19472
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG19472%27 HTTP/1.1" 200 None
2026-03-28 11:31:56 [auto1.be] INFO: Scrape type for MG19472: 0
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-28 11:31:56 [auto1.be] INFO: Scrape type for KP16725: 0
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: MR50383
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR50383%27 HTTP/1.1" 200 None
2026-03-28 11:31:56 [auto1.be] INFO: Scrape type for MR50383: 0
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: EJ45818
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: WX63908
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: RL53364
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: VZ37622
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ37622%27 HTTP/1.1" 200 None
2026-03-28 11:31:56 [auto1.be] INFO: Scrape type for VZ37622: 0
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: NM48533
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM48533%27 HTTP/1.1" 200 None
2026-03-28 11:31:56 [auto1.be] INFO: Scrape type for NM48533: 0
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-28 11:31:56 [auto1.be] INFO: Scrape type for CS76215: 0
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: SM52966
2026-03-28 11:31:56 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-28 11:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:57 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-28 11:31:57 [auto1.be] INFO: Scrape type for WL68728: 0
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: WV71876
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV71876%27 HTTP/1.1" 200 None
2026-03-28 11:31:57 [auto1.be] INFO: Scrape type for WV71876: 0
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: SX01610
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX01610%27 HTTP/1.1" 200 None
2026-03-28 11:31:57 [auto1.be] INFO: Scrape type for SX01610: 0
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: FR59063
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: UT85674
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT85674%27 HTTP/1.1" 200 None
2026-03-28 11:31:57 [auto1.be] INFO: Scrape type for UT85674: 0
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: BZ82774
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: RR37378
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR37378%27 HTTP/1.1" 200 None
2026-03-28 11:31:57 [auto1.be] INFO: Scrape type for RR37378: 0
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: KS18318
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: MZ55081
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ55081%27 HTTP/1.1" 200 None
2026-03-28 11:31:57 [auto1.be] INFO: Scrape type for MZ55081: 0
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: MW21160
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: FK67306
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: ET32561
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET32561%27 HTTP/1.1" 200 None
2026-03-28 11:31:57 [auto1.be] INFO: Scrape type for ET32561: 0
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: KE17510
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-28 11:31:57 [auto1.be] INFO: Scrape type for DH21315: 0
2026-03-28 11:31:57 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-28 11:31:57 [auto1.be] INFO: Scrape type for TV92859: 2
2026-03-28 11:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0 with identifier: TV92859
2026-03-28 11:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0 with scrape type 2
2026-03-28 11:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0 with scrape type 2
2026-03-28 11:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0, identifier: TV92859
2026-03-28 11:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0 with identifier: TV92859
2026-03-28 11:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0 with identifier: TV92859
2026-03-28 11:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0 with identifier: TV92859 to the API
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:58:46Z',
 'fuel_type': 'hybrid',
 'id': '67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV92859',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 190539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2019}
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-28 11:31:57 [auto1.be] INFO: Saving data for TV92859: {'auction_closing_time': 1774717126.0, 'created_time': 1773233830.873199, 'last_price_update_time': 1774697517.958217}
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TV92859') HTTP/1.1" 204 0
2026-03-28 11:31:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for CS46585: 0
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS12124%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for TS12124: 0
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: CM71971
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM71971%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for CM71971: 0
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for DY95002: 0
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for CH34151: 0
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: VY13057
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY13057%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for VY13057: 0
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: FG30090
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG30090%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for FG30090: 0
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for MK11042: 2
2026-03-28 11:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd with identifier: MK11042
2026-03-28 11:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd with scrape type 2
2026-03-28 11:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd with scrape type 2
2026-03-28 11:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd, identifier: MK11042
2026-03-28 11:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd with identifier: MK11042
2026-03-28 11:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd with identifier: MK11042
2026-03-28 11:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd with identifier: MK11042 to the API
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:28:39Z',
 'fuel_type': 'petrol',
 'id': 'c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK11042',
 'listing': 'auction',
 'make': 'Cadillac',
 'model': 'SRX',
 'odometer': 250249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-01',
 'seller_name': None,
 'title': 'Cadillac SRX 3.6 V6 AWD Elegance',
 'transmission': 'automatic',
 'trim': 'AWD Elegance',
 'year': 2007}
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Saving data for MK11042: {'auction_closing_time': 1774715319.0, 'created_time': 1774513859.243721, 'last_price_update_time': 1774697518.691178}
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MK11042') HTTP/1.1" 204 0
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: PD86825
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD86825%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for PD86825: 0
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: WS17719
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS17719%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for WS17719: 0
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: MJ84457
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ84457%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for MJ84457: 0
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: HJ27727
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: AP97194
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: LT43988
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT43988%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for LT43988: 0
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: GV95180
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV95180%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for GV95180: 0
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: TP87063
2026-03-28 11:31:58 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY90857%27 HTTP/1.1" 200 None
2026-03-28 11:31:58 [auto1.be] INFO: Scrape type for DY90857: 0
2026-03-28 11:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:31:59 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1816 | hits on page: 40
2026-03-28 11:31:59 [auto1.be] INFO: Found listing with ID: BF21618
2026-03-28 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF21618%27 HTTP/1.1" 200 None
2026-03-28 11:31:59 [auto1.be] INFO: Scrape type for BF21618: 0
2026-03-28 11:31:59 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-28 11:31:59 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-28 11:31:59 [auto1.be] INFO: Found listing with ID: JL40552
2026-03-28 11:31:59 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC05502%27 HTTP/1.1" 200 None
2026-03-28 11:32:00 [auto1.be] INFO: Scrape type for ZC05502: 0
2026-03-28 11:32:00 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL40372%27 HTTP/1.1" 200 None
2026-03-28 11:32:00 [auto1.be] INFO: Scrape type for EL40372: 0
2026-03-28 11:32:00 [auto1.be] INFO: Found listing with ID: NA79982
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA79982%27 HTTP/1.1" 200 None
2026-03-28 11:32:00 [auto1.be] INFO: Scrape type for NA79982: 2
2026-03-28 11:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 344f30aa-1db9-5c42-95e7-7cfe5faf8196 with identifier: NA79982
2026-03-28 11:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 344f30aa-1db9-5c42-95e7-7cfe5faf8196 with scrape type 2
2026-03-28 11:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 344f30aa-1db9-5c42-95e7-7cfe5faf8196 with scrape type 2
2026-03-28 11:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 344f30aa-1db9-5c42-95e7-7cfe5faf8196, identifier: NA79982
2026-03-28 11:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 344f30aa-1db9-5c42-95e7-7cfe5faf8196 with identifier: NA79982
2026-03-28 11:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 344f30aa-1db9-5c42-95e7-7cfe5faf8196 with identifier: NA79982
2026-03-28 11:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 344f30aa-1db9-5c42-95e7-7cfe5faf8196 with identifier: NA79982 to the API
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:12:03Z',
 'fuel_type': 'diesel',
 'id': '344f30aa-1db9-5c42-95e7-7cfe5faf8196',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA79982',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 86333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-21',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2022}
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA79982%27 HTTP/1.1" 200 None
2026-03-28 11:32:00 [auto1.be] INFO: Saving data for NA79982: {'auction_closing_time': 1774714323.0, 'created_time': 1774513850.091085, 'last_price_update_time': 1774697520.46566}
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NA79982') HTTP/1.1" 204 0
2026-03-28 11:32:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:00 [auto1.be] INFO: Found listing with ID: CA12532
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA12532%27 HTTP/1.1" 200 None
2026-03-28 11:32:00 [auto1.be] INFO: Scrape type for CA12532: 0
2026-03-28 11:32:00 [auto1.be] INFO: Found listing with ID: AB89489
2026-03-28 11:32:00 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-28 11:32:00 [auto1.be] INFO: Scrape type for JF41683: 2
2026-03-28 11:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8 with identifier: JF41683
2026-03-28 11:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8 with scrape type 2
2026-03-28 11:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8 with scrape type 2
2026-03-28 11:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8, identifier: JF41683
2026-03-28 11:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8 with identifier: JF41683
2026-03-28 11:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8 with identifier: JF41683
2026-03-28 11:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8 with identifier: JF41683 to the API
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-28T16:37:24Z',
 'fuel_type': 'petrol',
 'id': '60c3a740-e601-52cc-90d1-e2e4e2e3e9e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF41683',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 115413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-18',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Saving data for JF41683: {'auction_closing_time': 1774715844.0, 'created_time': 1774513864.698212, 'last_price_update_time': 1774697521.038793}
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JF41683') HTTP/1.1" 204 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Scrape type for FR80699: 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Scrape type for SE23508: 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Scrape type for YS56392: 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: AF35218
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: WG25655
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: MG71639
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG71639%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Scrape type for MG71639: 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: XT74022
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: XC37877
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC37877%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Scrape type for XC37877: 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: BR44079
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: KN27020
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: KP60973
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP60973%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Scrape type for KP60973: 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: NK66135
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK66135%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Scrape type for NK66135: 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Scrape type for BK01349: 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: JY55711
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY55711%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Scrape type for JY55711: 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: NP40379
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP40379%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Scrape type for NP40379: 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: RX78624
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX78624%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Scrape type for RX78624: 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: AC35394
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Scrape type for RK82839: 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: JX10335
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-28 11:32:01 [auto1.be] INFO: Scrape type for MN41841: 0
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: HM70865
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: RR60731
2026-03-28 11:32:01 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-28 11:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:02 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-28 11:32:02 [auto1.be] INFO: Scrape type for KM93600: 0
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH79590%27 HTTP/1.1" 200 None
2026-03-28 11:32:02 [auto1.be] INFO: Scrape type for DH79590: 0
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-28 11:32:02 [auto1.be] INFO: Scrape type for WP21428: 2
2026-03-28 11:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b78166-5849-517d-be53-a1fff69962ef with identifier: WP21428
2026-03-28 11:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b78166-5849-517d-be53-a1fff69962ef with scrape type 2
2026-03-28 11:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65b78166-5849-517d-be53-a1fff69962ef with scrape type 2
2026-03-28 11:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 65b78166-5849-517d-be53-a1fff69962ef, identifier: WP21428
2026-03-28 11:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 65b78166-5849-517d-be53-a1fff69962ef with identifier: WP21428
2026-03-28 11:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 65b78166-5849-517d-be53-a1fff69962ef with identifier: WP21428
2026-03-28 11:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 65b78166-5849-517d-be53-a1fff69962ef with identifier: WP21428 to the API
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:10:39Z',
 'fuel_type': 'diesel',
 'id': '65b78166-5849-517d-be53-a1fff69962ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP21428',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 30965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-14',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi L2 Trend',
 'transmission': 'automatic',
 'trim': 'L2 Trend',
 'year': 2023}
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-28 11:32:02 [auto1.be] INFO: Saving data for WP21428: {'auction_closing_time': 1774714239.0, 'created_time': 1774513861.5767, 'last_price_update_time': 1774697522.744936}
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP21428') HTTP/1.1" 204 0
2026-03-28 11:32:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: SD12606
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD12606%27 HTTP/1.1" 200 None
2026-03-28 11:32:02 [auto1.be] INFO: Scrape type for SD12606: 0
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: NZ68355
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ68355%27 HTTP/1.1" 200 None
2026-03-28 11:32:02 [auto1.be] INFO: Scrape type for NZ68355: 0
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: EM34677
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM34677%27 HTTP/1.1" 200 None
2026-03-28 11:32:02 [auto1.be] INFO: Scrape type for EM34677: 0
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: MR16317
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: CP38880
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: VW93174
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: SW05863
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW05863%27 HTTP/1.1" 200 None
2026-03-28 11:32:02 [auto1.be] INFO: Scrape type for SW05863: 0
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: ZB89914
2026-03-28 11:32:02 [auto1.be] INFO: Found listing with ID: EW28397
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW28397%27 HTTP/1.1" 200 None
2026-03-28 11:32:02 [auto1.be] INFO: Scrape type for EW28397: 2
2026-03-28 11:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fb1b7da-41ff-5201-a8e4-369d78247316 with identifier: EW28397
2026-03-28 11:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fb1b7da-41ff-5201-a8e4-369d78247316 with scrape type 2
2026-03-28 11:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fb1b7da-41ff-5201-a8e4-369d78247316 with scrape type 2
2026-03-28 11:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3fb1b7da-41ff-5201-a8e4-369d78247316, identifier: EW28397
2026-03-28 11:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3fb1b7da-41ff-5201-a8e4-369d78247316 with identifier: EW28397
2026-03-28 11:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3fb1b7da-41ff-5201-a8e4-369d78247316 with identifier: EW28397
2026-03-28 11:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3fb1b7da-41ff-5201-a8e4-369d78247316 with identifier: EW28397 to the API
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:09:34Z',
 'fuel_type': 'petrol',
 'id': '3fb1b7da-41ff-5201-a8e4-369d78247316',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW28397',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 90584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2014}
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW28397%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Saving data for EW28397: {'auction_closing_time': 1774714174.0, 'created_time': 1774513848.53052, 'last_price_update_time': 1774697523.400748}
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EW28397') HTTP/1.1" 204 0
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: CZ35254
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ35254%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Scrape type for CZ35254: 0
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU40393%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Scrape type for XU40393: 0
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: DK36221
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK36221%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Scrape type for DK36221: 0
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: RS16246
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16246%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Scrape type for RS16246: 0
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: ZC75548
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW36552%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Scrape type for CW36552: 0
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: CB02189
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: FJ85398
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: EN96756
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN96756%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Scrape type for EN96756: 0
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: RG16696
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG16696%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Scrape type for RG16696: 0
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: PC39555
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: FD01860
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD01860%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Scrape type for FD01860: 0
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE06051%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Scrape type for PE06051: 0
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: XN84271
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH78267%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Scrape type for PH78267: 0
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: YS23980
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS23980%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Scrape type for YS23980: 0
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: HW03040
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU19738%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Scrape type for SU19738: 0
2026-03-28 11:32:03 [auto1.be] INFO: Found listing with ID: XN65088
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN65088%27 HTTP/1.1" 200 None
2026-03-28 11:32:03 [auto1.be] INFO: Scrape type for XN65088: 0
2026-03-28 11:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:04 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: YH93162
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: FB63888
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: MB61651
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB61651%27 HTTP/1.1" 200 None
2026-03-28 11:32:04 [auto1.be] INFO: Scrape type for MB61651: 0
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: JL90308
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL90308%27 HTTP/1.1" 200 None
2026-03-28 11:32:04 [auto1.be] INFO: Scrape type for JL90308: 0
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-28 11:32:04 [auto1.be] INFO: Scrape type for TR87241: 0
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC87174%27 HTTP/1.1" 200 None
2026-03-28 11:32:04 [auto1.be] INFO: Scrape type for ZC87174: 0
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: GX95713
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX95713%27 HTTP/1.1" 200 None
2026-03-28 11:32:04 [auto1.be] INFO: Scrape type for GX95713: 0
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: HE27589
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: MA95611
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-28 11:32:04 [auto1.be] INFO: Scrape type for VP73114: 0
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: TC02969
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: YN67239
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: PF50688
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF50688%27 HTTP/1.1" 200 None
2026-03-28 11:32:04 [auto1.be] INFO: Scrape type for PF50688: 0
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF75491%27 HTTP/1.1" 200 None
2026-03-28 11:32:04 [auto1.be] INFO: Scrape type for UF75491: 0
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: KW79847
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW79847%27 HTTP/1.1" 200 None
2026-03-28 11:32:04 [auto1.be] INFO: Scrape type for KW79847: 0
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-28 11:32:04 [auto1.be] INFO: Scrape type for UL34611: 0
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: RW46644
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-28 11:32:04 [auto1.be] INFO: Scrape type for SD60477: 0
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: SM94010
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM94010%27 HTTP/1.1" 200 None
2026-03-28 11:32:04 [auto1.be] INFO: Scrape type for SM94010: 0
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-28 11:32:04 [auto1.be] INFO: Found listing with ID: PS48856
2026-03-28 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS48856%27 HTTP/1.1" 200 None
2026-03-28 11:32:05 [auto1.be] INFO: Scrape type for PS48856: 0
2026-03-28 11:32:05 [auto1.be] INFO: Found listing with ID: MS47880
2026-03-28 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS47880%27 HTTP/1.1" 200 None
2026-03-28 11:32:05 [auto1.be] INFO: Scrape type for MS47880: 0
2026-03-28 11:32:05 [auto1.be] INFO: Found listing with ID: LH74784
2026-03-28 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH74784%27 HTTP/1.1" 200 None
2026-03-28 11:32:05 [auto1.be] INFO: Scrape type for LH74784: 0
2026-03-28 11:32:05 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-28 11:32:05 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-28 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-28 11:32:05 [auto1.be] INFO: Scrape type for VA87646: 2
2026-03-28 11:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75c91631-8280-54df-b14a-ddae458034fa with identifier: VA87646
2026-03-28 11:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75c91631-8280-54df-b14a-ddae458034fa with scrape type 2
2026-03-28 11:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75c91631-8280-54df-b14a-ddae458034fa with scrape type 2
2026-03-28 11:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 75c91631-8280-54df-b14a-ddae458034fa, identifier: VA87646
2026-03-28 11:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 75c91631-8280-54df-b14a-ddae458034fa with identifier: VA87646
2026-03-28 11:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 75c91631-8280-54df-b14a-ddae458034fa with identifier: VA87646
2026-03-28 11:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 75c91631-8280-54df-b14a-ddae458034fa with identifier: VA87646 to the API
2026-03-28 11:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:14:16Z',
 'fuel_type': 'petrol',
 'id': '75c91631-8280-54df-b14a-ddae458034fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA87646',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 87119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-04',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2016}
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-28 11:32:06 [auto1.be] INFO: Saving data for VA87646: {'auction_closing_time': 1774714456.0, 'created_time': 1774513856.710235, 'last_price_update_time': 1774697526.596565}
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA87646') HTTP/1.1" 204 0
2026-03-28 11:32:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:06 [auto1.be] INFO: Found listing with ID: NF55706
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NF55706%27 HTTP/1.1" 200 None
2026-03-28 11:32:06 [auto1.be] INFO: Scrape type for NF55706: 0
2026-03-28 11:32:06 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD78607%27 HTTP/1.1" 200 None
2026-03-28 11:32:06 [auto1.be] INFO: Scrape type for PD78607: 0
2026-03-28 11:32:06 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX58483%27 HTTP/1.1" 200 None
2026-03-28 11:32:06 [auto1.be] INFO: Scrape type for ZX58483: 0
2026-03-28 11:32:06 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-28 11:32:06 [auto1.be] INFO: Found listing with ID: GX65351
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX65351%27 HTTP/1.1" 200 None
2026-03-28 11:32:06 [auto1.be] INFO: Scrape type for GX65351: 0
2026-03-28 11:32:06 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-28 11:32:06 [auto1.be] INFO: Scrape type for ZM46816: 0
2026-03-28 11:32:06 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-28 11:32:06 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-28 11:32:06 [auto1.be] INFO: Found listing with ID: HS55716
2026-03-28 11:32:06 [scrapy.extensions.logstats] INFO: Crawled 119 pages (at 33 pages/min), scraped 80 items (at 52 items/min)
2026-03-28 11:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-28 11:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:07 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:07 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-28 11:32:07 [auto1.be] INFO: Found listing with ID: KG32291
2026-03-28 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG32291%27 HTTP/1.1" 200 None
2026-03-28 11:32:07 [auto1.be] INFO: Scrape type for KG32291: 2
2026-03-28 11:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fae64aa-688e-53e7-a6b3-20fb9f4781a7 with identifier: KG32291
2026-03-28 11:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fae64aa-688e-53e7-a6b3-20fb9f4781a7 with scrape type 2
2026-03-28 11:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fae64aa-688e-53e7-a6b3-20fb9f4781a7 with scrape type 2
2026-03-28 11:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6fae64aa-688e-53e7-a6b3-20fb9f4781a7, identifier: KG32291
2026-03-28 11:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6fae64aa-688e-53e7-a6b3-20fb9f4781a7 with identifier: KG32291
2026-03-28 11:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6fae64aa-688e-53e7-a6b3-20fb9f4781a7 with identifier: KG32291
2026-03-28 11:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6fae64aa-688e-53e7-a6b3-20fb9f4781a7 with identifier: KG32291 to the API
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-28T16:17:29Z',
 'fuel_type': 'petrol',
 'id': '6fae64aa-688e-53e7-a6b3-20fb9f4781a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG32291',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 29305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-01',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S ALL4 Untamed Edition',
 'transmission': 'automatic',
 'trim': 'ALL4 Untamed Edition',
 'year': 2022}
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG32291%27 HTTP/1.1" 200 None
2026-03-28 11:32:08 [auto1.be] INFO: Saving data for KG32291: {'auction_closing_time': 1774714649.0, 'created_time': 1774513849.436625, 'last_price_update_time': 1774697528.332214}
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG32291') HTTP/1.1" 204 0
2026-03-28 11:32:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:08 [auto1.be] INFO: Found listing with ID: UB82847
2026-03-28 11:32:08 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-28 11:32:08 [auto1.be] INFO: Scrape type for TS87416: 0
2026-03-28 11:32:08 [auto1.be] INFO: Found listing with ID: HR21590
2026-03-28 11:32:08 [auto1.be] INFO: Found listing with ID: WG39475
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG39475%27 HTTP/1.1" 200 None
2026-03-28 11:32:08 [auto1.be] INFO: Scrape type for WG39475: 2
2026-03-28 11:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f31bf45-5177-5eea-b6ec-8a214ce2e1dc with identifier: WG39475
2026-03-28 11:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f31bf45-5177-5eea-b6ec-8a214ce2e1dc with scrape type 2
2026-03-28 11:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f31bf45-5177-5eea-b6ec-8a214ce2e1dc with scrape type 2
2026-03-28 11:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f31bf45-5177-5eea-b6ec-8a214ce2e1dc, identifier: WG39475
2026-03-28 11:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f31bf45-5177-5eea-b6ec-8a214ce2e1dc with identifier: WG39475
2026-03-28 11:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f31bf45-5177-5eea-b6ec-8a214ce2e1dc with identifier: WG39475
2026-03-28 11:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f31bf45-5177-5eea-b6ec-8a214ce2e1dc with identifier: WG39475 to the API
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:55:36Z',
 'fuel_type': 'diesel',
 'id': '9f31bf45-5177-5eea-b6ec-8a214ce2e1dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG39475',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 71605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2021}
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG39475%27 HTTP/1.1" 200 None
2026-03-28 11:32:08 [auto1.be] INFO: Saving data for WG39475: {'auction_closing_time': 1774716936.0, 'created_time': 1773822676.178963, 'last_price_update_time': 1774697528.929837}
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG39475') HTTP/1.1" 204 0
2026-03-28 11:32:08 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-28 11:32:08 [auto1.be] INFO: Scrape type for GT11330: 0
2026-03-28 11:32:08 [auto1.be] INFO: Found listing with ID: NE31569
2026-03-28 11:32:08 [auto1.be] INFO: Found listing with ID: KS62440
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS62440%27 HTTP/1.1" 200 None
2026-03-28 11:32:08 [auto1.be] INFO: Scrape type for KS62440: 0
2026-03-28 11:32:08 [auto1.be] INFO: Found listing with ID: CL62340
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CL62340%27 HTTP/1.1" 200 None
2026-03-28 11:32:08 [auto1.be] INFO: Scrape type for CL62340: 0
2026-03-28 11:32:08 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-28 11:32:09 [auto1.be] INFO: Scrape type for HM84114: 2
2026-03-28 11:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 598a5a4c-96de-506d-ade6-640b25698ac9 with identifier: HM84114
2026-03-28 11:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 598a5a4c-96de-506d-ade6-640b25698ac9 with scrape type 2
2026-03-28 11:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 598a5a4c-96de-506d-ade6-640b25698ac9 with scrape type 2
2026-03-28 11:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 598a5a4c-96de-506d-ade6-640b25698ac9, identifier: HM84114
2026-03-28 11:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 598a5a4c-96de-506d-ade6-640b25698ac9 with identifier: HM84114
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 11:32:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 598a5a4c-96de-506d-ade6-640b25698ac9 with identifier: HM84114
2026-03-28 11:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 598a5a4c-96de-506d-ade6-640b25698ac9 with identifier: HM84114 to the API
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:05:52Z',
 'fuel_type': 'gas',
 'id': '598a5a4c-96de-506d-ade6-640b25698ac9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM84114',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 90166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-31',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TGI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2019}
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-28 11:32:09 [auto1.be] INFO: Saving data for HM84114: {'auction_closing_time': 1774713952.0, 'created_time': 1774125146.159218, 'last_price_update_time': 1774697529.569501}
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HM84114') HTTP/1.1" 204 0
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: TF25932
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: ND85214
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND85214%27 HTTP/1.1" 200 None
2026-03-28 11:32:09 [auto1.be] INFO: Scrape type for ND85214: 0
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: BD17756
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: EA67135
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA67135%27 HTTP/1.1" 200 None
2026-03-28 11:32:09 [auto1.be] INFO: Scrape type for EA67135: 0
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: WT96819
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: GE05105
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: BE11259
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE11259%27 HTTP/1.1" 200 None
2026-03-28 11:32:09 [auto1.be] INFO: Scrape type for BE11259: 0
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: XM85548
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: LH22912
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: EP73132
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: YN92139
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: WP33906
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP33906%27 HTTP/1.1" 200 None
2026-03-28 11:32:09 [auto1.be] INFO: Scrape type for WP33906: 0
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: VU67376
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU67376%27 HTTP/1.1" 200 None
2026-03-28 11:32:09 [auto1.be] INFO: Scrape type for VU67376: 0
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-28 11:32:09 [auto1.be] INFO: Scrape type for VH38978: 0
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: YK21410
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: HN48415
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ53898%27 HTTP/1.1" 200 None
2026-03-28 11:32:09 [auto1.be] INFO: Scrape type for TZ53898: 0
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR41774%27 HTTP/1.1" 200 None
2026-03-28 11:32:09 [auto1.be] INFO: Scrape type for WR41774: 0
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: ZX75796
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: WN00182
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-28 11:32:09 [auto1.be] INFO: Scrape type for TU47744: 0
2026-03-28 11:32:09 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-28 11:32:09 [auto1.be] INFO: Scrape type for ZK51287: 2
2026-03-28 11:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a with identifier: ZK51287
2026-03-28 11:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a with scrape type 2
2026-03-28 11:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a with scrape type 2
2026-03-28 11:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a, identifier: ZK51287
2026-03-28 11:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a with identifier: ZK51287
2026-03-28 11:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a with identifier: ZK51287
2026-03-28 11:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a with identifier: ZK51287 to the API
2026-03-28 11:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:03:38Z',
 'fuel_type': 'diesel',
 'id': 'fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK51287',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 71954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-16',
 'seller_name': None,
 'title': 'Jaguar XF 2.2 D Eco',
 'transmission': 'automatic',
 'trim': 'Eco',
 'year': 2014}
2026-03-28 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-28 11:32:10 [auto1.be] INFO: Saving data for ZK51287: {'auction_closing_time': 1774713818.0, 'created_time': 1774513858.892983, 'last_price_update_time': 1774697530.180793}
2026-03-28 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZK51287') HTTP/1.1" 204 0
2026-03-28 11:32:10 [auto1.be] INFO: Found listing with ID: RK77715
2026-03-28 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK77715%27 HTTP/1.1" 200 None
2026-03-28 11:32:10 [auto1.be] INFO: Scrape type for RK77715: 0
2026-03-28 11:32:10 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-28 11:32:10 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-28 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS28625%27 HTTP/1.1" 200 None
2026-03-28 11:32:10 [auto1.be] INFO: Scrape type for PS28625: 0
2026-03-28 11:32:10 [auto1.be] INFO: Found listing with ID: HF21497
2026-03-28 11:32:10 [auto1.be] INFO: Found listing with ID: CK03982
2026-03-28 11:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:11 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: CH15441
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for DF96327: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for SZ65946: 2
2026-03-28 11:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b51171fe-f531-5ad7-996b-129f0fc32398 with identifier: SZ65946
2026-03-28 11:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51171fe-f531-5ad7-996b-129f0fc32398 with scrape type 2
2026-03-28 11:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b51171fe-f531-5ad7-996b-129f0fc32398 with scrape type 2
2026-03-28 11:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b51171fe-f531-5ad7-996b-129f0fc32398, identifier: SZ65946
2026-03-28 11:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b51171fe-f531-5ad7-996b-129f0fc32398 with identifier: SZ65946
2026-03-28 11:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b51171fe-f531-5ad7-996b-129f0fc32398 with identifier: SZ65946
2026-03-28 11:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b51171fe-f531-5ad7-996b-129f0fc32398 with identifier: SZ65946 to the API
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:06:38Z',
 'fuel_type': 'diesel',
 'id': 'b51171fe-f531-5ad7-996b-129f0fc32398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ65946',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 280276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-17',
 'seller_name': None,
 'title': 'BMW 3er 318d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2019}
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Saving data for SZ65946: {'auction_closing_time': 1774713998.0, 'created_time': 1774125073.571205, 'last_price_update_time': 1774697531.557508}
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ65946') HTTP/1.1" 204 0
2026-03-28 11:32:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: YC19133
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC19133%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for YC19133: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: AB27373
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB27373%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for AB27373: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: HM28534
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: YN58260
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: ZC53588
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: WG60858
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: DC51589
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC51589%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for DC51589: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: PA07784
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: GH28824
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH28824%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for GH28824: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: MM41011
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM41011%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for MM41011: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: JL24574
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for NM84060: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD20873%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for SD20873: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: GB18331
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: NB44505
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB44505%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for NB44505: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: ZJ69289
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ69289%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for ZJ69289: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: HJ12403
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ12403%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for HJ12403: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: RE83981
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE83981%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for RE83981: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: EM39704
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM39704%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for EM39704: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for RM46702: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: RJ65357
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ65357%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for RJ65357: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for YL67549: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: GE98600
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: XT89751
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT89751%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for XT89751: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: UM50519
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for WA39171: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: LC40144
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC40144%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for LC40144: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: DZ47511
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ47511%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for DZ47511: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: PR67057
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR67057%27 HTTP/1.1" 200 None
2026-03-28 11:32:11 [auto1.be] INFO: Scrape type for PR67057: 0
2026-03-28 11:32:11 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-28 11:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:13 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: UL98118
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL86303%27 HTTP/1.1" 200 None
2026-03-28 11:32:13 [auto1.be] INFO: Scrape type for VL86303: 0
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT02833%27 HTTP/1.1" 200 None
2026-03-28 11:32:13 [auto1.be] INFO: Scrape type for DT02833: 0
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: MG56126
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG56126%27 HTTP/1.1" 200 None
2026-03-28 11:32:13 [auto1.be] INFO: Scrape type for MG56126: 0
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: KW49487
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: JC58807
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: PA01247
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: FJ18494
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ18494%27 HTTP/1.1" 200 None
2026-03-28 11:32:13 [auto1.be] INFO: Scrape type for FJ18494: 0
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-28 11:32:13 [auto1.be] INFO: Scrape type for LE69229: 0
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: NV96305
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: MC77569
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC77569%27 HTTP/1.1" 200 None
2026-03-28 11:32:13 [auto1.be] INFO: Scrape type for MC77569: 0
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: PN32726
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: FR29123
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR29123%27 HTTP/1.1" 200 None
2026-03-28 11:32:13 [auto1.be] INFO: Scrape type for FR29123: 0
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX71438%27 HTTP/1.1" 200 None
2026-03-28 11:32:13 [auto1.be] INFO: Scrape type for TX71438: 0
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: VK27252
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: ZL06267
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: KY96002
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KY96002%27 HTTP/1.1" 200 None
2026-03-28 11:32:13 [auto1.be] INFO: Scrape type for KY96002: 0
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: ZU65660
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU65660%27 HTTP/1.1" 200 None
2026-03-28 11:32:13 [auto1.be] INFO: Scrape type for ZU65660: 0
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: TY50069
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY50069%27 HTTP/1.1" 200 None
2026-03-28 11:32:13 [auto1.be] INFO: Scrape type for TY50069: 0
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: LH83403
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH83403%27 HTTP/1.1" 200 None
2026-03-28 11:32:13 [auto1.be] INFO: Scrape type for LH83403: 0
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: HP77494
2026-03-28 11:32:13 [auto1.be] INFO: Found listing with ID: WV42280
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV42280%27 HTTP/1.1" 200 None
2026-03-28 11:32:13 [auto1.be] INFO: Scrape type for WV42280: 2
2026-03-28 11:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17bad26f-44a4-5d60-93bd-f673bd207f54 with identifier: WV42280
2026-03-28 11:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17bad26f-44a4-5d60-93bd-f673bd207f54 with scrape type 2
2026-03-28 11:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17bad26f-44a4-5d60-93bd-f673bd207f54 with scrape type 2
2026-03-28 11:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17bad26f-44a4-5d60-93bd-f673bd207f54, identifier: WV42280
2026-03-28 11:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17bad26f-44a4-5d60-93bd-f673bd207f54 with identifier: WV42280
2026-03-28 11:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17bad26f-44a4-5d60-93bd-f673bd207f54 with identifier: WV42280
2026-03-28 11:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17bad26f-44a4-5d60-93bd-f673bd207f54 with identifier: WV42280 to the API
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:45:16Z',
 'fuel_type': 'diesel',
 'id': '17bad26f-44a4-5d60-93bd-f673bd207f54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV42280',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 228933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-10',
 'seller_name': None,
 'title': 'Skoda Superb 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-28 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV42280%27 HTTP/1.1" 200 None
2026-03-28 11:32:14 [auto1.be] INFO: Saving data for WV42280: {'auction_closing_time': 1774716316.0, 'created_time': 1774513836.445108, 'last_price_update_time': 1774697534.098881}
2026-03-28 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV42280') HTTP/1.1" 204 0
2026-03-28 11:32:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:14 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-28 11:32:14 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-28 11:32:14 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-28 11:32:14 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-28 11:32:14 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-28 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH74025%27 HTTP/1.1" 200 None
2026-03-28 11:32:14 [auto1.be] INFO: Scrape type for XH74025: 0
2026-03-28 11:32:14 [auto1.be] INFO: Found listing with ID: LM10661
2026-03-28 11:32:14 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-28 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-28 11:32:14 [auto1.be] INFO: Scrape type for DS23322: 0
2026-03-28 11:32:14 [auto1.be] INFO: Found listing with ID: GA94606
2026-03-28 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA94606%27 HTTP/1.1" 200 None
2026-03-28 11:32:14 [auto1.be] INFO: Scrape type for GA94606: 0
2026-03-28 11:32:14 [auto1.be] INFO: Found listing with ID: WJ73148
2026-03-28 11:32:14 [auto1.be] INFO: Found listing with ID: UD69238
2026-03-28 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD69238%27 HTTP/1.1" 200 None
2026-03-28 11:32:14 [auto1.be] INFO: Scrape type for UD69238: 0
2026-03-28 11:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:15 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for UD97693: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for YG22909: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: PE30752
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE30752%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for PE30752: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: LX91228
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX91228%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for LX91228: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: NN41814
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN41814%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for NN41814: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: UB59400
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: JW19159
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW19159%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for JW19159: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: FV38279
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: XH16695
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH16695%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for XH16695: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: EY06710
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: RX67951
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: RB45450
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB45450%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for RB45450: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: MP38676
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP38676%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for MP38676: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: VA35443
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA35443%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for VA35443: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for UB84592: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: ZM98751
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: AT11769
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT11769%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for AT11769: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: TA16395
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA16395%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for TA16395: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: YU29895
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: BD79780
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD79780%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for BD79780: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: WW25551
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW25551%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for WW25551: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: PC47788
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC06950%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for PC06950: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: XJ17204
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT61211%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for WT61211: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: YY54111
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY54111%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for YY54111: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: JX95723
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: JP70611
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: BY20411
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: UK22118
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK22118%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for UK22118: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: GM27988
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM27988%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for GM27988: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: ED46000
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: MU65745
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: RK66755
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK66755%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for RK66755: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: KU14362
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU14362%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for KU14362: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: CK52379
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK52379%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for CK52379: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: ED08551
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED08551%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for ED08551: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: UL77551
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL77551%27 HTTP/1.1" 200 None
2026-03-28 11:32:15 [auto1.be] INFO: Scrape type for UL77551: 0
2026-03-28 11:32:15 [auto1.be] INFO: Found listing with ID: UV66357
2026-03-28 11:32:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:16 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: PL62845
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL62845%27 HTTP/1.1" 200 None
2026-03-28 11:32:16 [auto1.be] INFO: Scrape type for PL62845: 0
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: DD15930
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD15930%27 HTTP/1.1" 200 None
2026-03-28 11:32:16 [auto1.be] INFO: Scrape type for DD15930: 0
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: CY27099
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY27099%27 HTTP/1.1" 200 None
2026-03-28 11:32:16 [auto1.be] INFO: Scrape type for CY27099: 0
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: XU96332
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: GS41207
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: RJ05295
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ05295%27 HTTP/1.1" 200 None
2026-03-28 11:32:16 [auto1.be] INFO: Scrape type for RJ05295: 0
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: SU53193
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: EG72902
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: YC45178
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-28 11:32:16 [auto1.be] INFO: Scrape type for WJ68976: 0
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: DM59351
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM59351%27 HTTP/1.1" 200 None
2026-03-28 11:32:16 [auto1.be] INFO: Scrape type for DM59351: 0
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: ZU26363
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: ZJ61910
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: FP51010
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP51010%27 HTTP/1.1" 200 None
2026-03-28 11:32:16 [auto1.be] INFO: Scrape type for FP51010: 0
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-28 11:32:16 [auto1.be] INFO: Scrape type for CH15764: 0
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: PH02429
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-28 11:32:16 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-28 11:32:17 [auto1.be] INFO: Scrape type for PK93774: 0
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: RK22486
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: YS95861
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS95861%27 HTTP/1.1" 200 None
2026-03-28 11:32:17 [auto1.be] INFO: Scrape type for YS95861: 0
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: SP17871
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-28 11:32:17 [auto1.be] INFO: Scrape type for AM54260: 0
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: LJ62513
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-28 11:32:17 [auto1.be] INFO: Scrape type for EA25293: 0
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-28 11:32:17 [auto1.be] INFO: Scrape type for YB94076: 0
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-28 11:32:17 [auto1.be] INFO: Scrape type for PT26763: 0
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-28 11:32:17 [auto1.be] INFO: Scrape type for KW15988: 0
2026-03-28 11:32:17 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ87524%27 HTTP/1.1" 200 None
2026-03-28 11:32:17 [auto1.be] INFO: Scrape type for MJ87524: 0
2026-03-28 11:32:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:18 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: EY95319
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY95319%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for EY95319: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for YB47559: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: HS77940
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS77940%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for HS77940: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for CX99155: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for JC96921: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for LP39108: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: PK56681
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: NB55851
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB55851%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for NB55851: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: YV05904
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV05904%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for YV05904: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: ED29224
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED29224%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for ED29224: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: TT40798
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT40798%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for TT40798: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: BY03378
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY03378%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for BY03378: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: DL69403
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL69403%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for DL69403: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: BW39031
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: ZC14202
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC14202%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for ZC14202: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: AB96361
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB96361%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for AB96361: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: BF15536
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: PC04988
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: YG09924
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG09924%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for YG09924: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: TG48894
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG48894%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for TG48894: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: HY14348
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: MJ44397
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ44397%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for MJ44397: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: EA81543
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA81543%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for EA81543: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for XT36171: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: UU52750
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: RA83369
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA83369%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for RA83369: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: GE95300
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB21184%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for DB21184: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: XN79579
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: WF25377
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF25377%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for WF25377: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: UB54556
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB54556%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for UB54556: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: UP37204
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UP37204%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for UP37204: 0
2026-03-28 11:32:18 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-28 11:32:18 [auto1.be] INFO: Scrape type for YF30387: 0
2026-03-28 11:32:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:19 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: TP34819
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: MV25434
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: EZ95206
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ95206%27 HTTP/1.1" 200 None
2026-03-28 11:32:19 [auto1.be] INFO: Scrape type for EZ95206: 0
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: XZ13946
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: JC83971
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: AG12322
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG12322%27 HTTP/1.1" 200 None
2026-03-28 11:32:19 [auto1.be] INFO: Scrape type for AG12322: 0
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: VJ63338
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-28 11:32:19 [auto1.be] INFO: Scrape type for SE12861: 0
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-28 11:32:19 [auto1.be] INFO: Scrape type for AW74184: 0
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: KT11413
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: WN35442
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN35442%27 HTTP/1.1" 200 None
2026-03-28 11:32:19 [auto1.be] INFO: Scrape type for WN35442: 0
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: HY09771
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: LB74355
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB74355%27 HTTP/1.1" 200 None
2026-03-28 11:32:19 [auto1.be] INFO: Scrape type for LB74355: 0
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: FY16186
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY16186%27 HTTP/1.1" 200 None
2026-03-28 11:32:19 [auto1.be] INFO: Scrape type for FY16186: 0
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: YD33796
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD33796%27 HTTP/1.1" 200 None
2026-03-28 11:32:19 [auto1.be] INFO: Scrape type for YD33796: 0
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: MA85452
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA85452%27 HTTP/1.1" 200 None
2026-03-28 11:32:19 [auto1.be] INFO: Scrape type for MA85452: 0
2026-03-28 11:32:19 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE91648%27 HTTP/1.1" 200 None
2026-03-28 11:32:20 [auto1.be] INFO: Scrape type for LE91648: 0
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH50113%27 HTTP/1.1" 200 None
2026-03-28 11:32:20 [auto1.be] INFO: Scrape type for FH50113: 0
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: UJ35064
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ35064%27 HTTP/1.1" 200 None
2026-03-28 11:32:20 [auto1.be] INFO: Scrape type for UJ35064: 0
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: FJ75207
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: EL87249
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-28 11:32:20 [auto1.be] INFO: Scrape type for TV22564: 0
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: UD25678
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD25678%27 HTTP/1.1" 200 None
2026-03-28 11:32:20 [auto1.be] INFO: Scrape type for UD25678: 0
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-28 11:32:20 [auto1.be] INFO: Scrape type for ME81448: 0
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-28 11:32:20 [auto1.be] INFO: Scrape type for XN92471: 0
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-28 11:32:20 [auto1.be] INFO: Scrape type for HH24769: 0
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: VS70966
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: LR03762
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-28 11:32:20 [auto1.be] INFO: Scrape type for RG44645: 0
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-28 11:32:20 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-28 11:32:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:21 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: VK87411
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK87411%27 HTTP/1.1" 200 None
2026-03-28 11:32:21 [auto1.be] INFO: Scrape type for VK87411: 0
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-28 11:32:21 [auto1.be] INFO: Scrape type for ZT52703: 0
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-28 11:32:21 [auto1.be] INFO: Scrape type for RK68346: 0
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: HH43502
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-28 11:32:21 [auto1.be] INFO: Scrape type for ZL81412: 0
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: CE21828
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: JR17508
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: RK20492
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK20492%27 HTTP/1.1" 200 None
2026-03-28 11:32:21 [auto1.be] INFO: Scrape type for RK20492: 0
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-28 11:32:21 [auto1.be] INFO: Scrape type for RM51088: 0
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: LF48909
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF48909%27 HTTP/1.1" 200 None
2026-03-28 11:32:21 [auto1.be] INFO: Scrape type for LF48909: 0
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-28 11:32:21 [auto1.be] INFO: Scrape type for FS62191: 0
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: CK64923
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: MS34473
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: MF52944
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF52944%27 HTTP/1.1" 200 None
2026-03-28 11:32:21 [auto1.be] INFO: Scrape type for MF52944: 0
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-28 11:32:21 [auto1.be] INFO: Scrape type for NY99560: 0
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-28 11:32:21 [auto1.be] INFO: Scrape type for LJ91533: 0
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-28 11:32:21 [auto1.be] INFO: Scrape type for AF71611: 0
2026-03-28 11:32:21 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-28 11:32:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:22 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for UU12218: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: KZ70715
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ70715%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for KZ70715: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: WW24606
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for WU43595: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for HG61894: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: VF96553
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: TR55859
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for EX56301: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: SL68944
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for LE66186: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for LA76788: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: XL87749
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL87749%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for XL87749: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: VV55176
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV55176%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for VV55176: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: CY69823
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY69823%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for CY69823: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: BV68544
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV68544%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for BV68544: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: CP59959
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for MV82025: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: ZU40891
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: PM95515
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for CS20047: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for HS49836: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for DY69036: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for DB02418: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: MA13965
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for RB98158: 0
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: XL31605
2026-03-28 11:32:22 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-28 11:32:22 [auto1.be] INFO: Scrape type for KC19835: 0
2026-03-28 11:32:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:24 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for MZ83142: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for WD81319: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: MC08958
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC08958%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for MC08958: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for NU46591: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for LZ48262: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for TY52799: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for RA46458: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for ET79377: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for CK14854: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: AM57328
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for KF59500: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for DW87206: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: FV08195
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for ZR52684: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: PW35881
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: ZG24921
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: GC38550
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: KT14369
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT14369%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for KT14369: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: TH87974
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: BE30662
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30662%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for BE30662: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: XL16576
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: DB28782
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB28782%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for DB28782: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: SP13149
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP13149%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for SP13149: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for SV23823: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: ST31185
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for HT96077: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: WT92928
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-28 11:32:24 [auto1.be] INFO: Scrape type for CR22525: 0
2026-03-28 11:32:24 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-28 11:32:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:25 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-28 11:32:25 [auto1.be] INFO: Scrape type for BC69430: 0
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: VT14549
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: WG79733
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: BB02902
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB02902%27 HTTP/1.1" 200 None
2026-03-28 11:32:25 [auto1.be] INFO: Scrape type for BB02902: 0
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-28 11:32:25 [auto1.be] INFO: Scrape type for AX12673: 0
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-28 11:32:25 [auto1.be] INFO: Scrape type for HY58683: 0
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-28 11:32:25 [auto1.be] INFO: Scrape type for CG91643: 0
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-28 11:32:25 [auto1.be] INFO: Scrape type for HT09098: 0
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: GB76910
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: WF72066
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-28 11:32:25 [auto1.be] INFO: Scrape type for PB25162: 0
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: RR14818
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-28 11:32:25 [auto1.be] INFO: Scrape type for SD15124: 0
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-28 11:32:25 [auto1.be] INFO: Scrape type for YJ00240: 0
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: RC34183
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: YL56745
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL56745%27 HTTP/1.1" 200 None
2026-03-28 11:32:25 [auto1.be] INFO: Scrape type for YL56745: 0
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: ZW68449
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW68449%27 HTTP/1.1" 200 None
2026-03-28 11:32:25 [auto1.be] INFO: Scrape type for ZW68449: 0
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: VZ41655
2026-03-28 11:32:25 [auto1.be] INFO: Found listing with ID: ME80219
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME80219%27 HTTP/1.1" 200 None
2026-03-28 11:32:25 [auto1.be] INFO: Scrape type for ME80219: 2
2026-03-28 11:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 764179fe-4ebf-5953-9878-9ec2c3b72eb1 with identifier: ME80219
2026-03-28 11:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1 with scrape type 2
2026-03-28 11:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 764179fe-4ebf-5953-9878-9ec2c3b72eb1 with scrape type 2
2026-03-28 11:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 764179fe-4ebf-5953-9878-9ec2c3b72eb1, identifier: ME80219
2026-03-28 11:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 764179fe-4ebf-5953-9878-9ec2c3b72eb1 with identifier: ME80219
2026-03-28 11:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 764179fe-4ebf-5953-9878-9ec2c3b72eb1 with identifier: ME80219
2026-03-28 11:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 764179fe-4ebf-5953-9878-9ec2c3b72eb1 with identifier: ME80219 to the API
2026-03-28 11:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:39:52Z',
 'fuel_type': 'diesel',
 'id': '764179fe-4ebf-5953-9878-9ec2c3b72eb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME80219',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 143889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-09',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-28 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME80219%27 HTTP/1.1" 200 None
2026-03-28 11:32:26 [auto1.be] INFO: Saving data for ME80219: {'auction_closing_time': 1774715992.0, 'created_time': 1774611072.168208, 'last_price_update_time': 1774697546.605555}
2026-03-28 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ME80219') HTTP/1.1" 204 0
2026-03-28 11:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:26 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-28 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-28 11:32:26 [auto1.be] INFO: Scrape type for VT00410: 2
2026-03-28 11:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec496ded-d4e0-525b-b85d-3e85669a7518 with identifier: VT00410
2026-03-28 11:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec496ded-d4e0-525b-b85d-3e85669a7518 with scrape type 2
2026-03-28 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec496ded-d4e0-525b-b85d-3e85669a7518 with scrape type 2
2026-03-28 11:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec496ded-d4e0-525b-b85d-3e85669a7518, identifier: VT00410
2026-03-28 11:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec496ded-d4e0-525b-b85d-3e85669a7518 with identifier: VT00410
2026-03-28 11:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec496ded-d4e0-525b-b85d-3e85669a7518 with identifier: VT00410
2026-03-28 11:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec496ded-d4e0-525b-b85d-3e85669a7518 with identifier: VT00410 to the API
2026-03-28 11:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:39:48Z',
 'fuel_type': 'petrol',
 'id': 'ec496ded-d4e0-525b-b85d-3e85669a7518',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT00410',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 95103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-06',
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Futura',
 'transmission': 'manual',
 'trim': 'Futura',
 'year': 2005}
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-28 11:32:27 [auto1.be] INFO: Saving data for VT00410: {'auction_closing_time': 1774715988.0, 'created_time': 1774611035.23839, 'last_price_update_time': 1774697547.097602}
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VT00410') HTTP/1.1" 204 0
2026-03-28 11:32:27 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-28 11:32:27 [auto1.be] INFO: Scrape type for WG89987: 2
2026-03-28 11:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64082240-6a27-58e4-8a93-93be97e7a50e with identifier: WG89987
2026-03-28 11:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64082240-6a27-58e4-8a93-93be97e7a50e with scrape type 2
2026-03-28 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64082240-6a27-58e4-8a93-93be97e7a50e with scrape type 2
2026-03-28 11:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64082240-6a27-58e4-8a93-93be97e7a50e, identifier: WG89987
2026-03-28 11:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64082240-6a27-58e4-8a93-93be97e7a50e with identifier: WG89987
2026-03-28 11:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64082240-6a27-58e4-8a93-93be97e7a50e with identifier: WG89987
2026-03-28 11:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64082240-6a27-58e4-8a93-93be97e7a50e with identifier: WG89987 to the API
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:15:45Z',
 'fuel_type': 'diesel',
 'id': '64082240-6a27-58e4-8a93-93be97e7a50e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG89987',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 221145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-24',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-28 11:32:27 [auto1.be] INFO: Saving data for WG89987: {'auction_closing_time': 1774714545.0, 'created_time': 1774611037.863469, 'last_price_update_time': 1774697547.534925}
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG89987') HTTP/1.1" 204 0
2026-03-28 11:32:27 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-28 11:32:27 [auto1.be] INFO: Scrape type for KE26750: 2
2026-03-28 11:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with identifier: KE26750
2026-03-28 11:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with scrape type 2
2026-03-28 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with scrape type 2
2026-03-28 11:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad, identifier: KE26750
2026-03-28 11:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with identifier: KE26750
2026-03-28 11:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with identifier: KE26750
2026-03-28 11:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with identifier: KE26750 to the API
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-28T16:59:45Z',
 'fuel_type': 'petrol',
 'id': '351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE26750',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 36437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-05',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2021}
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-28 11:32:27 [auto1.be] INFO: Saving data for KE26750: {'auction_closing_time': 1774717185.0, 'created_time': 1774611034.023467, 'last_price_update_time': 1774697547.911202}
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KE26750') HTTP/1.1" 204 0
2026-03-28 11:32:27 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-28 11:32:27 [auto1.be] INFO: Found listing with ID: TY10971
2026-03-28 11:32:27 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-28 11:32:27 [auto1.be] INFO: Scrape type for ZM54310: 2
2026-03-28 11:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f6523e0-a241-5558-8415-d2dc5206accb with identifier: ZM54310
2026-03-28 11:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f6523e0-a241-5558-8415-d2dc5206accb with scrape type 2
2026-03-28 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f6523e0-a241-5558-8415-d2dc5206accb with scrape type 2
2026-03-28 11:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6f6523e0-a241-5558-8415-d2dc5206accb, identifier: ZM54310
2026-03-28 11:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6f6523e0-a241-5558-8415-d2dc5206accb with identifier: ZM54310
2026-03-28 11:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6f6523e0-a241-5558-8415-d2dc5206accb with identifier: ZM54310
2026-03-28 11:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6f6523e0-a241-5558-8415-d2dc5206accb with identifier: ZM54310 to the API
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-28T16:45:09Z',
 'fuel_type': 'petrol',
 'id': '6f6523e0-a241-5558-8415-d2dc5206accb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM54310',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 123698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-08',
 'seller_name': None,
 'title': 'Peugeot 307 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2007}
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-28 11:32:28 [auto1.be] INFO: Saving data for ZM54310: {'auction_closing_time': 1774716309.0, 'created_time': 1774611072.593123, 'last_price_update_time': 1774697548.286731}
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM54310') HTTP/1.1" 204 0
2026-03-28 11:32:28 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-28 11:32:28 [auto1.be] INFO: Scrape type for VP90118: 2
2026-03-28 11:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 804ce7e0-f7ca-5ca5-886f-e36716f80878 with identifier: VP90118
2026-03-28 11:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 804ce7e0-f7ca-5ca5-886f-e36716f80878 with scrape type 2
2026-03-28 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 804ce7e0-f7ca-5ca5-886f-e36716f80878 with scrape type 2
2026-03-28 11:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 804ce7e0-f7ca-5ca5-886f-e36716f80878, identifier: VP90118
2026-03-28 11:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 804ce7e0-f7ca-5ca5-886f-e36716f80878 with identifier: VP90118
2026-03-28 11:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 804ce7e0-f7ca-5ca5-886f-e36716f80878 with identifier: VP90118
2026-03-28 11:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 804ce7e0-f7ca-5ca5-886f-e36716f80878 with identifier: VP90118 to the API
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:13:32Z',
 'fuel_type': 'petrol',
 'id': '804ce7e0-f7ca-5ca5-886f-e36716f80878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP90118',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 72102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-21',
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-28 11:32:28 [auto1.be] INFO: Saving data for VP90118: {'auction_closing_time': 1774714412.0, 'created_time': 1774611032.761359, 'last_price_update_time': 1774697548.688993}
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP90118') HTTP/1.1" 204 0
2026-03-28 11:32:28 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-28 11:32:28 [auto1.be] INFO: Scrape type for RW14221: 2
2026-03-28 11:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 532e3e3d-434a-58a8-92c5-32b9a70d214b with identifier: RW14221
2026-03-28 11:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 532e3e3d-434a-58a8-92c5-32b9a70d214b with scrape type 2
2026-03-28 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 532e3e3d-434a-58a8-92c5-32b9a70d214b with scrape type 2
2026-03-28 11:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 532e3e3d-434a-58a8-92c5-32b9a70d214b, identifier: RW14221
2026-03-28 11:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 532e3e3d-434a-58a8-92c5-32b9a70d214b with identifier: RW14221
2026-03-28 11:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 532e3e3d-434a-58a8-92c5-32b9a70d214b with identifier: RW14221
2026-03-28 11:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 532e3e3d-434a-58a8-92c5-32b9a70d214b with identifier: RW14221 to the API
2026-03-28 11:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:04Z',
 'fuel_type': 'petrol',
 'id': '532e3e3d-434a-58a8-92c5-32b9a70d214b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW14221',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 128746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-28 11:32:29 [auto1.be] INFO: Saving data for RW14221: {'auction_closing_time': 1774716544.0, 'created_time': 1773952768.31199, 'last_price_update_time': 1774697549.34119}
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW14221') HTTP/1.1" 204 0
2026-03-28 11:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:29 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:29 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-28 11:32:29 [auto1.be] INFO: Scrape type for VB04696: 2
2026-03-28 11:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1452a75b-4551-5745-b36a-48fe36f546f8 with identifier: VB04696
2026-03-28 11:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1452a75b-4551-5745-b36a-48fe36f546f8 with scrape type 2
2026-03-28 11:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1452a75b-4551-5745-b36a-48fe36f546f8 with scrape type 2
2026-03-28 11:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1452a75b-4551-5745-b36a-48fe36f546f8, identifier: VB04696
2026-03-28 11:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1452a75b-4551-5745-b36a-48fe36f546f8 with identifier: VB04696
2026-03-28 11:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1452a75b-4551-5745-b36a-48fe36f546f8 with identifier: VB04696
2026-03-28 11:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1452a75b-4551-5745-b36a-48fe36f546f8 with identifier: VB04696 to the API
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:07:01Z',
 'fuel_type': 'petrol',
 'id': '1452a75b-4551-5745-b36a-48fe36f546f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB04696',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 106180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-28 11:32:29 [auto1.be] INFO: Saving data for VB04696: {'auction_closing_time': 1774714021.0, 'created_time': 1773866643.764642, 'last_price_update_time': 1774697549.844087}
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VB04696') HTTP/1.1" 204 0
2026-03-28 11:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:29 [auto1.be] INFO: Found listing with ID: DB11071
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB11071%27 HTTP/1.1" 200 None
2026-03-28 11:32:29 [auto1.be] INFO: Scrape type for DB11071: 2
2026-03-28 11:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a9378dd-2203-5033-8a48-292148cd8edf with identifier: DB11071
2026-03-28 11:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9378dd-2203-5033-8a48-292148cd8edf with scrape type 2
2026-03-28 11:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a9378dd-2203-5033-8a48-292148cd8edf with scrape type 2
2026-03-28 11:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a9378dd-2203-5033-8a48-292148cd8edf, identifier: DB11071
2026-03-28 11:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a9378dd-2203-5033-8a48-292148cd8edf with identifier: DB11071
2026-03-28 11:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a9378dd-2203-5033-8a48-292148cd8edf with identifier: DB11071
2026-03-28 11:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a9378dd-2203-5033-8a48-292148cd8edf with identifier: DB11071 to the API
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:29:19Z',
 'fuel_type': 'diesel',
 'id': '5a9378dd-2203-5033-8a48-292148cd8edf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB11071',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 89776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-29',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Ocean Race',
 'transmission': 'manual',
 'trim': 'Ocean Race',
 'year': 2015}
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB11071%27 HTTP/1.1" 200 None
2026-03-28 11:32:30 [auto1.be] INFO: Saving data for DB11071: {'auction_closing_time': 1774715359.0, 'created_time': 1774611068.968814, 'last_price_update_time': 1774697550.301269}
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB11071') HTTP/1.1" 204 0
2026-03-28 11:32:30 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-28 11:32:30 [auto1.be] INFO: Scrape type for UA98228: 2
2026-03-28 11:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d4ae1a9-8910-597b-8128-538de3e6069c with identifier: UA98228
2026-03-28 11:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d4ae1a9-8910-597b-8128-538de3e6069c with scrape type 2
2026-03-28 11:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d4ae1a9-8910-597b-8128-538de3e6069c with scrape type 2
2026-03-28 11:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d4ae1a9-8910-597b-8128-538de3e6069c, identifier: UA98228
2026-03-28 11:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d4ae1a9-8910-597b-8128-538de3e6069c with identifier: UA98228
2026-03-28 11:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d4ae1a9-8910-597b-8128-538de3e6069c with identifier: UA98228
2026-03-28 11:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d4ae1a9-8910-597b-8128-538de3e6069c with identifier: UA98228 to the API
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:40:03Z',
 'fuel_type': 'diesel',
 'id': '9d4ae1a9-8910-597b-8128-538de3e6069c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA98228',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 160588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-01',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-28 11:32:30 [auto1.be] INFO: Saving data for UA98228: {'auction_closing_time': 1774716003.0, 'created_time': 1773833650.804224, 'last_price_update_time': 1774697550.695017}
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA98228') HTTP/1.1" 204 0
2026-03-28 11:32:30 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-28 11:32:30 [auto1.be] INFO: Scrape type for WH33984: 2
2026-03-28 11:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with identifier: WH33984
2026-03-28 11:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with scrape type 2
2026-03-28 11:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with scrape type 2
2026-03-28 11:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8, identifier: WH33984
2026-03-28 11:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with identifier: WH33984
2026-03-28 11:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with identifier: WH33984
2026-03-28 11:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with identifier: WH33984 to the API
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:06:17Z',
 'fuel_type': 'diesel',
 'id': '0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH33984',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 287672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-06',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi ECOnetic',
 'transmission': 'manual',
 'trim': 'ECOnetic',
 'year': 2010}
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-28 11:32:31 [auto1.be] INFO: Saving data for WH33984: {'auction_closing_time': 1774713977.0, 'created_time': 1773909043.405104, 'last_price_update_time': 1774697551.399905}
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH33984') HTTP/1.1" 204 0
2026-03-28 11:32:31 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-28 11:32:31 [auto1.be] INFO: Scrape type for DP96573: 2
2026-03-28 11:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bcbf188-681f-5ef8-915a-1befaf5e4bff with identifier: DP96573
2026-03-28 11:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bcbf188-681f-5ef8-915a-1befaf5e4bff with scrape type 2
2026-03-28 11:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bcbf188-681f-5ef8-915a-1befaf5e4bff with scrape type 2
2026-03-28 11:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3bcbf188-681f-5ef8-915a-1befaf5e4bff, identifier: DP96573
2026-03-28 11:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3bcbf188-681f-5ef8-915a-1befaf5e4bff with identifier: DP96573
2026-03-28 11:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3bcbf188-681f-5ef8-915a-1befaf5e4bff with identifier: DP96573
2026-03-28 11:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3bcbf188-681f-5ef8-915a-1befaf5e4bff with identifier: DP96573 to the API
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:46:23Z',
 'fuel_type': 'petrol',
 'id': '3bcbf188-681f-5ef8-915a-1befaf5e4bff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP96573',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 151445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-28 11:32:31 [auto1.be] INFO: Saving data for DP96573: {'auction_closing_time': 1774716383.0, 'created_time': 1774611039.485237, 'last_price_update_time': 1774697551.814969}
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP96573') HTTP/1.1" 204 0
2026-03-28 11:32:31 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD22160%27 HTTP/1.1" 200 None
2026-03-28 11:32:31 [auto1.be] INFO: Scrape type for BD22160: 2
2026-03-28 11:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07fa1a96-c02b-5f32-ad25-b54f089197a8 with identifier: BD22160
2026-03-28 11:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07fa1a96-c02b-5f32-ad25-b54f089197a8 with scrape type 2
2026-03-28 11:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07fa1a96-c02b-5f32-ad25-b54f089197a8 with scrape type 2
2026-03-28 11:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 07fa1a96-c02b-5f32-ad25-b54f089197a8, identifier: BD22160
2026-03-28 11:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 07fa1a96-c02b-5f32-ad25-b54f089197a8 with identifier: BD22160
2026-03-28 11:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 07fa1a96-c02b-5f32-ad25-b54f089197a8 with identifier: BD22160
2026-03-28 11:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 07fa1a96-c02b-5f32-ad25-b54f089197a8 with identifier: BD22160 to the API
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:10:42Z',
 'fuel_type': 'hybrid',
 'id': '07fa1a96-c02b-5f32-ad25-b54f089197a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD22160',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 81628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-03',
 'seller_name': None,
 'title': 'Audi A7 Sportback 55 TFSIe quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD22160%27 HTTP/1.1" 200 None
2026-03-28 11:32:32 [auto1.be] INFO: Saving data for BD22160: {'auction_closing_time': 1774714242.0, 'created_time': 1774352261.344766, 'last_price_update_time': 1774697552.220428}
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BD22160') HTTP/1.1" 204 0
2026-03-28 11:32:32 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-28 11:32:32 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-28 11:32:32 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-28 11:32:32 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-28 11:32:32 [auto1.be] INFO: Found listing with ID: DL37030
2026-03-28 11:32:32 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-28 11:32:32 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-28 11:32:32 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-28 11:32:32 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-28 11:32:32 [auto1.be] INFO: Scrape type for KD31542: 2
2026-03-28 11:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b610291a-d6ec-5e07-83c5-c74f2366cddc with identifier: KD31542
2026-03-28 11:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b610291a-d6ec-5e07-83c5-c74f2366cddc with scrape type 2
2026-03-28 11:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b610291a-d6ec-5e07-83c5-c74f2366cddc with scrape type 2
2026-03-28 11:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b610291a-d6ec-5e07-83c5-c74f2366cddc, identifier: KD31542
2026-03-28 11:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b610291a-d6ec-5e07-83c5-c74f2366cddc with identifier: KD31542
2026-03-28 11:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b610291a-d6ec-5e07-83c5-c74f2366cddc with identifier: KD31542
2026-03-28 11:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b610291a-d6ec-5e07-83c5-c74f2366cddc with identifier: KD31542 to the API
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:41:49Z',
 'fuel_type': 'diesel',
 'id': 'b610291a-d6ec-5e07-83c5-c74f2366cddc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD31542',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 209678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-06',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2010}
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-28 11:32:32 [auto1.be] INFO: Saving data for KD31542: {'auction_closing_time': 1774716109.0, 'created_time': 1773747320.527256, 'last_price_update_time': 1774697552.614175}
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KD31542') HTTP/1.1" 204 0
2026-03-28 11:32:32 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-28 11:32:32 [auto1.be] INFO: Scrape type for LE55631: 2
2026-03-28 11:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8013032f-390a-5eea-966f-854d34707c70 with identifier: LE55631
2026-03-28 11:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8013032f-390a-5eea-966f-854d34707c70 with scrape type 2
2026-03-28 11:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8013032f-390a-5eea-966f-854d34707c70 with scrape type 2
2026-03-28 11:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8013032f-390a-5eea-966f-854d34707c70, identifier: LE55631
2026-03-28 11:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8013032f-390a-5eea-966f-854d34707c70 with identifier: LE55631
2026-03-28 11:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8013032f-390a-5eea-966f-854d34707c70 with identifier: LE55631
2026-03-28 11:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8013032f-390a-5eea-966f-854d34707c70 with identifier: LE55631 to the API
2026-03-28 11:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:17:24Z',
 'fuel_type': 'petrol',
 'id': '8013032f-390a-5eea-966f-854d34707c70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE55631',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 98347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-27',
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2019}
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-28 11:32:33 [auto1.be] INFO: Saving data for LE55631: {'auction_closing_time': 1774714644.0, 'created_time': 1774611069.779502, 'last_price_update_time': 1774697553.117482}
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE55631') HTTP/1.1" 204 0
2026-03-28 11:32:33 [auto1.be] INFO: Found listing with ID: KB74591
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB74591%27 HTTP/1.1" 200 None
2026-03-28 11:32:33 [auto1.be] INFO: Scrape type for KB74591: 2
2026-03-28 11:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f620c6db-e201-522a-a54b-ed85a09b2f43 with identifier: KB74591
2026-03-28 11:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f620c6db-e201-522a-a54b-ed85a09b2f43 with scrape type 2
2026-03-28 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f620c6db-e201-522a-a54b-ed85a09b2f43 with scrape type 2
2026-03-28 11:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f620c6db-e201-522a-a54b-ed85a09b2f43, identifier: KB74591
2026-03-28 11:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f620c6db-e201-522a-a54b-ed85a09b2f43 with identifier: KB74591
2026-03-28 11:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f620c6db-e201-522a-a54b-ed85a09b2f43 with identifier: KB74591
2026-03-28 11:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f620c6db-e201-522a-a54b-ed85a09b2f43 with identifier: KB74591 to the API
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:25:28Z',
 'fuel_type': 'diesel',
 'id': 'f620c6db-e201-522a-a54b-ed85a09b2f43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB74591',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 97720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-18',
 'seller_name': None,
 'title': 'BMW X2 xDrive 20d M Sport X',
 'transmission': 'automatic',
 'trim': 'M Sport X',
 'year': 2018}
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB74591%27 HTTP/1.1" 200 None
2026-03-28 11:32:33 [auto1.be] INFO: Saving data for KB74591: {'auction_closing_time': 1774715128.0, 'created_time': 1774611077.90274, 'last_price_update_time': 1774697553.53675}
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KB74591') HTTP/1.1" 204 0
2026-03-28 11:32:33 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-28 11:32:33 [auto1.be] INFO: Scrape type for SZ60181: 2
2026-03-28 11:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with identifier: SZ60181
2026-03-28 11:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with scrape type 2
2026-03-28 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with scrape type 2
2026-03-28 11:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d, identifier: SZ60181
2026-03-28 11:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with identifier: SZ60181
2026-03-28 11:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with identifier: SZ60181
2026-03-28 11:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with identifier: SZ60181 to the API
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:15:20Z',
 'fuel_type': 'diesel',
 'id': '7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ60181',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 137341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-07',
 'seller_name': None,
 'title': 'Skoda Octavia 1.9 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-28 11:32:33 [auto1.be] INFO: Saving data for SZ60181: {'auction_closing_time': 1774714520.0, 'created_time': 1774611051.594755, 'last_price_update_time': 1774697553.912197}
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ60181') HTTP/1.1" 204 0
2026-03-28 11:32:33 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-28 11:32:33 [auto1.be] INFO: Scrape type for PY12122: 2
2026-03-28 11:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45ffa21f-0452-5540-9c3b-b3e53e421a5d with identifier: PY12122
2026-03-28 11:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45ffa21f-0452-5540-9c3b-b3e53e421a5d with scrape type 2
2026-03-28 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45ffa21f-0452-5540-9c3b-b3e53e421a5d with scrape type 2
2026-03-28 11:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45ffa21f-0452-5540-9c3b-b3e53e421a5d, identifier: PY12122
2026-03-28 11:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45ffa21f-0452-5540-9c3b-b3e53e421a5d with identifier: PY12122
2026-03-28 11:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45ffa21f-0452-5540-9c3b-b3e53e421a5d with identifier: PY12122
2026-03-28 11:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45ffa21f-0452-5540-9c3b-b3e53e421a5d with identifier: PY12122 to the API
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:07:27Z',
 'fuel_type': 'diesel',
 'id': '45ffa21f-0452-5540-9c3b-b3e53e421a5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY12122',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 125711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-14',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi GT L1',
 'transmission': 'manual',
 'trim': 'GT L1',
 'year': 2019}
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-28 11:32:34 [auto1.be] INFO: Saving data for PY12122: {'auction_closing_time': 1774714047.0, 'created_time': 1773866527.193939, 'last_price_update_time': 1774697554.307581}
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY12122') HTTP/1.1" 204 0
2026-03-28 11:32:34 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-28 11:32:34 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-28 11:32:34 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-28 11:32:34 [auto1.be] INFO: Scrape type for UW21644: 2
2026-03-28 11:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d85aef54-640f-5d98-9b99-1c2927a173a1 with identifier: UW21644
2026-03-28 11:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85aef54-640f-5d98-9b99-1c2927a173a1 with scrape type 2
2026-03-28 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d85aef54-640f-5d98-9b99-1c2927a173a1 with scrape type 2
2026-03-28 11:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d85aef54-640f-5d98-9b99-1c2927a173a1, identifier: UW21644
2026-03-28 11:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d85aef54-640f-5d98-9b99-1c2927a173a1 with identifier: UW21644
2026-03-28 11:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d85aef54-640f-5d98-9b99-1c2927a173a1 with identifier: UW21644
2026-03-28 11:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d85aef54-640f-5d98-9b99-1c2927a173a1 with identifier: UW21644 to the API
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:27:24Z',
 'fuel_type': 'diesel',
 'id': 'd85aef54-640f-5d98-9b99-1c2927a173a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW21644',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 259485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-30',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2010}
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-28 11:32:34 [auto1.be] INFO: Saving data for UW21644: {'auction_closing_time': 1774715244.0, 'created_time': 1774611054.735589, 'last_price_update_time': 1774697554.681747}
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UW21644') HTTP/1.1" 204 0
2026-03-28 11:32:34 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-28 11:32:34 [auto1.be] INFO: Scrape type for SC85120: 2
2026-03-28 11:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f350627-37d4-5531-94ae-9eb0c0194e94 with identifier: SC85120
2026-03-28 11:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f350627-37d4-5531-94ae-9eb0c0194e94 with scrape type 2
2026-03-28 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f350627-37d4-5531-94ae-9eb0c0194e94 with scrape type 2
2026-03-28 11:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f350627-37d4-5531-94ae-9eb0c0194e94, identifier: SC85120
2026-03-28 11:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f350627-37d4-5531-94ae-9eb0c0194e94 with identifier: SC85120
2026-03-28 11:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f350627-37d4-5531-94ae-9eb0c0194e94 with identifier: SC85120
2026-03-28 11:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f350627-37d4-5531-94ae-9eb0c0194e94 with identifier: SC85120 to the API
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:08:03Z',
 'fuel_type': 'diesel',
 'id': '8f350627-37d4-5531-94ae-9eb0c0194e94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC85120',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 185071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-03',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-28 11:32:35 [auto1.be] INFO: Saving data for SC85120: {'auction_closing_time': 1774714083.0, 'created_time': 1774611100.495429, 'last_price_update_time': 1774697555.105649}
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC85120') HTTP/1.1" 204 0
2026-03-28 11:32:35 [auto1.be] INFO: Found listing with ID: BU79691
2026-03-28 11:32:35 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-28 11:32:35 [auto1.be] INFO: Scrape type for MC44479: 2
2026-03-28 11:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4eca24b-c4ad-563a-8208-c53776c7a282 with identifier: MC44479
2026-03-28 11:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4eca24b-c4ad-563a-8208-c53776c7a282 with scrape type 2
2026-03-28 11:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4eca24b-c4ad-563a-8208-c53776c7a282 with scrape type 2
2026-03-28 11:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4eca24b-c4ad-563a-8208-c53776c7a282, identifier: MC44479
2026-03-28 11:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4eca24b-c4ad-563a-8208-c53776c7a282 with identifier: MC44479
2026-03-28 11:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4eca24b-c4ad-563a-8208-c53776c7a282 with identifier: MC44479
2026-03-28 11:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4eca24b-c4ad-563a-8208-c53776c7a282 with identifier: MC44479 to the API
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:47:02Z',
 'fuel_type': 'diesel',
 'id': 'e4eca24b-c4ad-563a-8208-c53776c7a282',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC44479',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 24280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-12',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-28 11:32:35 [auto1.be] INFO: Saving data for MC44479: {'auction_closing_time': 1774716422.0, 'created_time': 1774611073.115855, 'last_price_update_time': 1774697555.502608}
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MC44479') HTTP/1.1" 204 0
2026-03-28 11:32:35 [auto1.be] INFO: Channel: 24h | Page: 40 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:35 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-28 11:32:35 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-28 11:32:35 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-28 11:32:35 [auto1.be] INFO: Scrape type for WH41445: 2
2026-03-28 11:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74c57867-c58f-5b18-9431-bbd8d599383b with identifier: WH41445
2026-03-28 11:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74c57867-c58f-5b18-9431-bbd8d599383b with scrape type 2
2026-03-28 11:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74c57867-c58f-5b18-9431-bbd8d599383b with scrape type 2
2026-03-28 11:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 74c57867-c58f-5b18-9431-bbd8d599383b, identifier: WH41445
2026-03-28 11:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 74c57867-c58f-5b18-9431-bbd8d599383b with identifier: WH41445
2026-03-28 11:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 74c57867-c58f-5b18-9431-bbd8d599383b with identifier: WH41445
2026-03-28 11:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 74c57867-c58f-5b18-9431-bbd8d599383b with identifier: WH41445 to the API
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:38:46Z',
 'fuel_type': 'diesel',
 'id': '74c57867-c58f-5b18-9431-bbd8d599383b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH41445',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 59167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-21',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2020}
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-28 11:32:35 [auto1.be] INFO: Saving data for WH41445: {'auction_closing_time': 1774715926.0, 'created_time': 1774611049.547412, 'last_price_update_time': 1774697555.90032}
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH41445') HTTP/1.1" 204 0
2026-03-28 11:32:36 [auto1.be] INFO: Found listing with ID: ET95220
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET95220%27 HTTP/1.1" 200 None
2026-03-28 11:32:36 [auto1.be] INFO: Scrape type for ET95220: 2
2026-03-28 11:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35b28bc1-1b8a-530f-8c02-1eebb7297e9b with identifier: ET95220
2026-03-28 11:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b with scrape type 2
2026-03-28 11:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35b28bc1-1b8a-530f-8c02-1eebb7297e9b with scrape type 2
2026-03-28 11:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 35b28bc1-1b8a-530f-8c02-1eebb7297e9b, identifier: ET95220
2026-03-28 11:32:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:36 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-28 11:32:36 [auto1.be] INFO: Scrape type for XC97675: 2
2026-03-28 11:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3c08361-dc63-50b9-9ce6-35e857cb8458 with identifier: XC97675
2026-03-28 11:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3c08361-dc63-50b9-9ce6-35e857cb8458 with scrape type 2
2026-03-28 11:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3c08361-dc63-50b9-9ce6-35e857cb8458 with scrape type 2
2026-03-28 11:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3c08361-dc63-50b9-9ce6-35e857cb8458, identifier: XC97675
2026-03-28 11:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 35b28bc1-1b8a-530f-8c02-1eebb7297e9b with identifier: ET95220
2026-03-28 11:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 35b28bc1-1b8a-530f-8c02-1eebb7297e9b with identifier: ET95220
2026-03-28 11:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 35b28bc1-1b8a-530f-8c02-1eebb7297e9b with identifier: ET95220 to the API
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:52:42Z',
 'fuel_type': 'petrol',
 'id': '35b28bc1-1b8a-530f-8c02-1eebb7297e9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET95220',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 184673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-25',
 'seller_name': None,
 'title': 'BMW 1er 114i',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET95220%27 HTTP/1.1" 200 None
2026-03-28 11:32:36 [auto1.be] INFO: Saving data for ET95220: {'auction_closing_time': 1774716762.0, 'created_time': 1774611066.601549, 'last_price_update_time': 1774697556.47026}
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET95220') HTTP/1.1" 204 0
2026-03-28 11:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3c08361-dc63-50b9-9ce6-35e857cb8458 with identifier: XC97675
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 11:32:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3c08361-dc63-50b9-9ce6-35e857cb8458 with identifier: XC97675
2026-03-28 11:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3c08361-dc63-50b9-9ce6-35e857cb8458 with identifier: XC97675 to the API
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:29:00Z',
 'fuel_type': 'petrol',
 'id': 'e3c08361-dc63-50b9-9ce6-35e857cb8458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC97675',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 60391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-28 11:32:36 [auto1.be] INFO: Saving data for XC97675: {'auction_closing_time': 1774715340.0, 'created_time': 1773909048.240341, 'last_price_update_time': 1774697556.919535}
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC97675') HTTP/1.1" 204 0
2026-03-28 11:32:36 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-28 11:32:36 [auto1.be] INFO: Scrape type for KF52558: 2
2026-03-28 11:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eccde05-fbe7-5db7-949b-a124dff01c9f with identifier: KF52558
2026-03-28 11:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eccde05-fbe7-5db7-949b-a124dff01c9f with scrape type 2
2026-03-28 11:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7eccde05-fbe7-5db7-949b-a124dff01c9f with scrape type 2
2026-03-28 11:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7eccde05-fbe7-5db7-949b-a124dff01c9f, identifier: KF52558
2026-03-28 11:32:37 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-28 11:32:37 [auto1.be] INFO: Scrape type for JS91211: 2
2026-03-28 11:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with identifier: JS91211
2026-03-28 11:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with scrape type 2
2026-03-28 11:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with scrape type 2
2026-03-28 11:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba, identifier: JS91211
2026-03-28 11:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7eccde05-fbe7-5db7-949b-a124dff01c9f with identifier: KF52558
2026-03-28 11:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7eccde05-fbe7-5db7-949b-a124dff01c9f with identifier: KF52558
2026-03-28 11:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7eccde05-fbe7-5db7-949b-a124dff01c9f with identifier: KF52558 to the API
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:17:02Z',
 'fuel_type': 'petrol',
 'id': '7eccde05-fbe7-5db7-949b-a124dff01c9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF52558',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 171979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-28 11:32:37 [auto1.be] INFO: Saving data for KF52558: {'auction_closing_time': 1774714622.0, 'created_time': 1773923068.671579, 'last_price_update_time': 1774697557.503205}
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF52558') HTTP/1.1" 204 0
2026-03-28 11:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with identifier: JS91211
2026-03-28 11:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with identifier: JS91211
2026-03-28 11:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with identifier: JS91211 to the API
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:55:43Z',
 'fuel_type': 'diesel',
 'id': '12e4a183-5766-5ba6-bfec-b32bcb9a25ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS91211',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 141385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-16',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 e-HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2015}
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-28 11:32:37 [auto1.be] INFO: Saving data for JS91211: {'auction_closing_time': 1774716943.0, 'created_time': 1774611108.864183, 'last_price_update_time': 1774697557.841071}
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS91211') HTTP/1.1" 204 0
2026-03-28 11:32:37 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-28 11:32:37 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-28 11:32:37 [auto1.be] INFO: Scrape type for UJ89543: 2
2026-03-28 11:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with identifier: UJ89543
2026-03-28 11:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with scrape type 2
2026-03-28 11:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with scrape type 2
2026-03-28 11:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f, identifier: UJ89543
2026-03-28 11:32:37 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-28 11:32:37 [auto1.be] INFO: Scrape type for XT90325: 2
2026-03-28 11:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a43692e3-7ce1-5b7d-86ec-bd984af3288e with identifier: XT90325
2026-03-28 11:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a43692e3-7ce1-5b7d-86ec-bd984af3288e with scrape type 2
2026-03-28 11:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a43692e3-7ce1-5b7d-86ec-bd984af3288e with scrape type 2
2026-03-28 11:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a43692e3-7ce1-5b7d-86ec-bd984af3288e, identifier: XT90325
2026-03-28 11:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with identifier: UJ89543
2026-03-28 11:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with identifier: UJ89543
2026-03-28 11:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with identifier: UJ89543 to the API
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:15:20Z',
 'fuel_type': 'diesel',
 'id': 'ba49b4c3-f8dc-57dd-9b37-0930265f7d1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ89543',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 142972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-04',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Adventure',
 'transmission': 'manual',
 'trim': 'Adventure',
 'year': 2014}
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-28 11:32:38 [auto1.be] INFO: Saving data for UJ89543: {'auction_closing_time': 1774714520.0, 'created_time': 1773909041.330022, 'last_price_update_time': 1774697558.354768}
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UJ89543') HTTP/1.1" 204 0
2026-03-28 11:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a43692e3-7ce1-5b7d-86ec-bd984af3288e with identifier: XT90325
2026-03-28 11:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a43692e3-7ce1-5b7d-86ec-bd984af3288e with identifier: XT90325
2026-03-28 11:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a43692e3-7ce1-5b7d-86ec-bd984af3288e with identifier: XT90325 to the API
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:10:17Z',
 'fuel_type': 'petrol',
 'id': 'a43692e3-7ce1-5b7d-86ec-bd984af3288e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT90325',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 241614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-21',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Vision 2WD',
 'transmission': 'manual',
 'trim': 'Vision 2WD',
 'year': 2014}
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-28 11:32:38 [auto1.be] INFO: Saving data for XT90325: {'auction_closing_time': 1774714217.0, 'created_time': 1774611107.000361, 'last_price_update_time': 1774697558.645002}
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT90325') HTTP/1.1" 204 0
2026-03-28 11:32:38 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-28 11:32:38 [auto1.be] INFO: Scrape type for UX94260: 2
2026-03-28 11:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bac25ec6-cc54-594b-abd2-706436b33277 with identifier: UX94260
2026-03-28 11:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bac25ec6-cc54-594b-abd2-706436b33277 with scrape type 2
2026-03-28 11:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bac25ec6-cc54-594b-abd2-706436b33277 with scrape type 2
2026-03-28 11:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bac25ec6-cc54-594b-abd2-706436b33277, identifier: UX94260
2026-03-28 11:32:38 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-28 11:32:38 [auto1.be] INFO: Scrape type for ZK00678: 2
2026-03-28 11:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with identifier: ZK00678
2026-03-28 11:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with scrape type 2
2026-03-28 11:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with scrape type 2
2026-03-28 11:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa, identifier: ZK00678
2026-03-28 11:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bac25ec6-cc54-594b-abd2-706436b33277 with identifier: UX94260
2026-03-28 11:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bac25ec6-cc54-594b-abd2-706436b33277 with identifier: UX94260
2026-03-28 11:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bac25ec6-cc54-594b-abd2-706436b33277 with identifier: UX94260 to the API
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:59:29Z',
 'fuel_type': 'petrol',
 'id': 'bac25ec6-cc54-594b-abd2-706436b33277',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX94260',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 147506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2016}
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-28 11:32:39 [auto1.be] INFO: Saving data for UX94260: {'auction_closing_time': 1774717169.0, 'created_time': 1774611067.378808, 'last_price_update_time': 1774697559.174939}
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UX94260') HTTP/1.1" 204 0
2026-03-28 11:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with identifier: ZK00678
2026-03-28 11:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with identifier: ZK00678
2026-03-28 11:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with identifier: ZK00678 to the API
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:12:24Z',
 'fuel_type': 'diesel',
 'id': '569eba0d-a06b-53bf-b4bc-4c5b5891dffa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK00678',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 148171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-17',
 'seller_name': None,
 'title': 'Skoda Roomster 1.6 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2013}
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-28 11:32:39 [auto1.be] INFO: Saving data for ZK00678: {'auction_closing_time': 1774714344.0, 'created_time': 1774611053.857631, 'last_price_update_time': 1774697559.436131}
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZK00678') HTTP/1.1" 204 0
2026-03-28 11:32:39 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-28 11:32:39 [auto1.be] INFO: Scrape type for FA63464: 2
2026-03-28 11:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d55df2ce-ceec-5a04-8351-8bfe516065a5 with identifier: FA63464
2026-03-28 11:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d55df2ce-ceec-5a04-8351-8bfe516065a5 with scrape type 2
2026-03-28 11:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d55df2ce-ceec-5a04-8351-8bfe516065a5 with scrape type 2
2026-03-28 11:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d55df2ce-ceec-5a04-8351-8bfe516065a5, identifier: FA63464
2026-03-28 11:32:39 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-28 11:32:39 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-28 11:32:39 [auto1.be] INFO: Scrape type for ED59297: 2
2026-03-28 11:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 159ad276-36e4-5fc6-9705-ac16c83cbb43 with identifier: ED59297
2026-03-28 11:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 159ad276-36e4-5fc6-9705-ac16c83cbb43 with scrape type 2
2026-03-28 11:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 159ad276-36e4-5fc6-9705-ac16c83cbb43 with scrape type 2
2026-03-28 11:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 159ad276-36e4-5fc6-9705-ac16c83cbb43, identifier: ED59297
2026-03-28 11:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d55df2ce-ceec-5a04-8351-8bfe516065a5 with identifier: FA63464
2026-03-28 11:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d55df2ce-ceec-5a04-8351-8bfe516065a5 with identifier: FA63464
2026-03-28 11:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d55df2ce-ceec-5a04-8351-8bfe516065a5 with identifier: FA63464 to the API
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:12:44Z',
 'fuel_type': 'diesel',
 'id': 'd55df2ce-ceec-5a04-8351-8bfe516065a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA63464',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 252739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-16',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-28 11:32:39 [auto1.be] INFO: Saving data for FA63464: {'auction_closing_time': 1774714364.0, 'created_time': 1774611052.962473, 'last_price_update_time': 1774697559.941635}
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA63464') HTTP/1.1" 204 0
2026-03-28 11:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 159ad276-36e4-5fc6-9705-ac16c83cbb43 with identifier: ED59297
2026-03-28 11:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 159ad276-36e4-5fc6-9705-ac16c83cbb43 with identifier: ED59297
2026-03-28 11:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 159ad276-36e4-5fc6-9705-ac16c83cbb43 with identifier: ED59297 to the API
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:09:22Z',
 'fuel_type': 'petrol',
 'id': '159ad276-36e4-5fc6-9705-ac16c83cbb43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED59297',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 84799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-18',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2023}
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-28 11:32:40 [auto1.be] INFO: Saving data for ED59297: {'auction_closing_time': 1774714162.0, 'created_time': 1774611048.04514, 'last_price_update_time': 1774697560.348426}
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ED59297') HTTP/1.1" 204 0
2026-03-28 11:32:40 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-28 11:32:40 [auto1.be] INFO: Scrape type for WA92632: 2
2026-03-28 11:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with identifier: WA92632
2026-03-28 11:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with scrape type 2
2026-03-28 11:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with scrape type 2
2026-03-28 11:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479, identifier: WA92632
2026-03-28 11:32:40 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-28 11:32:40 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-28 11:32:40 [auto1.be] INFO: Scrape type for WD60187: 2
2026-03-28 11:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d20b14f-7890-5077-89b1-e5edd3895e73 with identifier: WD60187
2026-03-28 11:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d20b14f-7890-5077-89b1-e5edd3895e73 with scrape type 2
2026-03-28 11:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d20b14f-7890-5077-89b1-e5edd3895e73 with scrape type 2
2026-03-28 11:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d20b14f-7890-5077-89b1-e5edd3895e73, identifier: WD60187
2026-03-28 11:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with identifier: WA92632
2026-03-28 11:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with identifier: WA92632
2026-03-28 11:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with identifier: WA92632 to the API
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:49:30Z',
 'fuel_type': 'diesel',
 'id': '325dacdd-d8ce-5187-80f3-fdaa6b2f5479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA92632',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 284968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-28',
 'seller_name': None,
 'title': 'Mazda 5 1.6 CD Diesel Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-28 11:32:40 [auto1.be] INFO: Saving data for WA92632: {'auction_closing_time': 1774716570.0, 'created_time': 1773865920.347381, 'last_price_update_time': 1774697560.92627}
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA92632') HTTP/1.1" 204 0
2026-03-28 11:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d20b14f-7890-5077-89b1-e5edd3895e73 with identifier: WD60187
2026-03-28 11:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d20b14f-7890-5077-89b1-e5edd3895e73 with identifier: WD60187
2026-03-28 11:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d20b14f-7890-5077-89b1-e5edd3895e73 with identifier: WD60187 to the API
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:18:55Z',
 'fuel_type': 'diesel',
 'id': '6d20b14f-7890-5077-89b1-e5edd3895e73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD60187',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 269111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-30',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
 'transmission': 'automatic',
 'trim': 'Overland',
 'year': 2014}
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-28 11:32:41 [auto1.be] INFO: Saving data for WD60187: {'auction_closing_time': 1774714735.0, 'created_time': 1773301772.752533, 'last_price_update_time': 1774697561.247069}
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WD60187') HTTP/1.1" 204 0
2026-03-28 11:32:41 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-28 11:32:41 [auto1.be] INFO: Scrape type for FN16517: 2
2026-03-28 11:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with identifier: FN16517
2026-03-28 11:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with scrape type 2
2026-03-28 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with scrape type 2
2026-03-28 11:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a90caf3-f8a5-56c6-9be0-336444f5ad60, identifier: FN16517
2026-03-28 11:32:41 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-28 11:32:41 [auto1.be] INFO: Scrape type for CC17071: 2
2026-03-28 11:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9609db3f-592b-5e29-9fc3-b596139b736a with identifier: CC17071
2026-03-28 11:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9609db3f-592b-5e29-9fc3-b596139b736a with scrape type 2
2026-03-28 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9609db3f-592b-5e29-9fc3-b596139b736a with scrape type 2
2026-03-28 11:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9609db3f-592b-5e29-9fc3-b596139b736a, identifier: CC17071
2026-03-28 11:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with identifier: FN16517
2026-03-28 11:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with identifier: FN16517
2026-03-28 11:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with identifier: FN16517 to the API
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:05:49Z',
 'fuel_type': 'diesel',
 'id': '2a90caf3-f8a5-56c6-9be0-336444f5ad60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN16517',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 137494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-17',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2014}
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-28 11:32:41 [auto1.be] INFO: Saving data for FN16517: {'auction_closing_time': 1774713949.0, 'created_time': 1774611057.312563, 'last_price_update_time': 1774697561.864051}
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FN16517') HTTP/1.1" 204 0
2026-03-28 11:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9609db3f-592b-5e29-9fc3-b596139b736a with identifier: CC17071
2026-03-28 11:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9609db3f-592b-5e29-9fc3-b596139b736a with identifier: CC17071
2026-03-28 11:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9609db3f-592b-5e29-9fc3-b596139b736a with identifier: CC17071 to the API
2026-03-28 11:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:49:48Z',
 'fuel_type': 'diesel',
 'id': '9609db3f-592b-5e29-9fc3-b596139b736a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC17071',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 192640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-16',
 'seller_name': None,
 'title': 'BMW 3er 320d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-28 11:32:42 [auto1.be] INFO: Saving data for CC17071: {'auction_closing_time': 1774716588.0, 'created_time': 1774611068.05205, 'last_price_update_time': 1774697562.152047}
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC17071') HTTP/1.1" 204 0
2026-03-28 11:32:42 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-28 11:32:42 [auto1.be] INFO: Scrape type for PS61885: 2
2026-03-28 11:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcda966d-d404-5865-9d88-beac13cfd6f7 with identifier: PS61885
2026-03-28 11:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcda966d-d404-5865-9d88-beac13cfd6f7 with scrape type 2
2026-03-28 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcda966d-d404-5865-9d88-beac13cfd6f7 with scrape type 2
2026-03-28 11:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dcda966d-d404-5865-9d88-beac13cfd6f7, identifier: PS61885
2026-03-28 11:32:42 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-28 11:32:42 [auto1.be] INFO: Scrape type for EP09858: 2
2026-03-28 11:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e537b69b-6ce4-5e73-9c9e-7817832184b8 with identifier: EP09858
2026-03-28 11:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e537b69b-6ce4-5e73-9c9e-7817832184b8 with scrape type 2
2026-03-28 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e537b69b-6ce4-5e73-9c9e-7817832184b8 with scrape type 2
2026-03-28 11:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e537b69b-6ce4-5e73-9c9e-7817832184b8, identifier: EP09858
2026-03-28 11:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dcda966d-d404-5865-9d88-beac13cfd6f7 with identifier: PS61885
2026-03-28 11:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dcda966d-d404-5865-9d88-beac13cfd6f7 with identifier: PS61885
2026-03-28 11:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dcda966d-d404-5865-9d88-beac13cfd6f7 with identifier: PS61885 to the API
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:32:11Z',
 'fuel_type': 'diesel',
 'id': 'dcda966d-d404-5865-9d88-beac13cfd6f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS61885',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 211796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-28 11:32:42 [auto1.be] INFO: Saving data for PS61885: {'auction_closing_time': 1774715531.0, 'created_time': 1773922620.738167, 'last_price_update_time': 1774697562.657422}
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS61885') HTTP/1.1" 204 0
2026-03-28 11:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e537b69b-6ce4-5e73-9c9e-7817832184b8 with identifier: EP09858
2026-03-28 11:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e537b69b-6ce4-5e73-9c9e-7817832184b8 with identifier: EP09858
2026-03-28 11:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e537b69b-6ce4-5e73-9c9e-7817832184b8 with identifier: EP09858 to the API
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:38:24Z',
 'fuel_type': 'diesel',
 'id': 'e537b69b-6ce4-5e73-9c9e-7817832184b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP09858',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 69950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-16',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2016}
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-28 11:32:42 [auto1.be] INFO: Saving data for EP09858: {'auction_closing_time': 1774715904.0, 'created_time': 1774611066.959538, 'last_price_update_time': 1774697562.9424}
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP09858') HTTP/1.1" 204 0
2026-03-28 11:32:42 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-28 11:32:42 [auto1.be] INFO: Scrape type for KW38150: 2
2026-03-28 11:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ce9160-39cd-5582-a186-21b1728d97d7 with identifier: KW38150
2026-03-28 11:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ce9160-39cd-5582-a186-21b1728d97d7 with scrape type 2
2026-03-28 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62ce9160-39cd-5582-a186-21b1728d97d7 with scrape type 2
2026-03-28 11:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 62ce9160-39cd-5582-a186-21b1728d97d7, identifier: KW38150
2026-03-28 11:32:43 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-28 11:32:43 [auto1.be] INFO: Scrape type for MF96479: 2
2026-03-28 11:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with identifier: MF96479
2026-03-28 11:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with scrape type 2
2026-03-28 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with scrape type 2
2026-03-28 11:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c6c0b4d-256b-588f-9919-5a2e28640ae5, identifier: MF96479
2026-03-28 11:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 62ce9160-39cd-5582-a186-21b1728d97d7 with identifier: KW38150
2026-03-28 11:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 62ce9160-39cd-5582-a186-21b1728d97d7 with identifier: KW38150
2026-03-28 11:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 62ce9160-39cd-5582-a186-21b1728d97d7 with identifier: KW38150 to the API
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:35:25Z',
 'fuel_type': 'petrol',
 'id': '62ce9160-39cd-5582-a186-21b1728d97d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW38150',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 154345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-06',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-28 11:32:43 [auto1.be] INFO: Saving data for KW38150: {'auction_closing_time': 1774715725.0, 'created_time': 1774611063.775505, 'last_price_update_time': 1774697563.409832}
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW38150') HTTP/1.1" 204 0
2026-03-28 11:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with identifier: MF96479
2026-03-28 11:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with identifier: MF96479
2026-03-28 11:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with identifier: MF96479 to the API
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:56Z',
 'fuel_type': 'diesel',
 'id': '2c6c0b4d-256b-588f-9919-5a2e28640ae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF96479',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 153674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-02',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-28 11:32:43 [auto1.be] INFO: Saving data for MF96479: {'auction_closing_time': 1774714736.0, 'created_time': 1773909040.513067, 'last_price_update_time': 1774697563.687453}
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MF96479') HTTP/1.1" 204 0
2026-03-28 11:32:43 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-28 11:32:43 [auto1.be] INFO: Scrape type for CU40853: 2
2026-03-28 11:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with identifier: CU40853
2026-03-28 11:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with scrape type 2
2026-03-28 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with scrape type 2
2026-03-28 11:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6, identifier: CU40853
2026-03-28 11:32:43 [auto1.be] INFO: Channel: 24h | Page: 41 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:43 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-28 11:32:43 [auto1.be] INFO: Scrape type for KA88762: 2
2026-03-28 11:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with identifier: KA88762
2026-03-28 11:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with scrape type 2
2026-03-28 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with scrape type 2
2026-03-28 11:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c, identifier: KA88762
2026-03-28 11:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with identifier: CU40853
2026-03-28 11:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with identifier: CU40853
2026-03-28 11:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with identifier: CU40853 to the API
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:14:48Z',
 'fuel_type': 'diesel',
 'id': 'd0c41ed0-9f3f-51bc-98be-62ba5f38d0a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU40853',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 139354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-14',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-28 11:32:44 [auto1.be] INFO: Saving data for CU40853: {'auction_closing_time': 1774714488.0, 'created_time': 1774611052.627411, 'last_price_update_time': 1774697564.198375}
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CU40853') HTTP/1.1" 204 0
2026-03-28 11:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with identifier: KA88762
2026-03-28 11:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with identifier: KA88762
2026-03-28 11:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with identifier: KA88762 to the API
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:55:13Z',
 'fuel_type': 'diesel',
 'id': '12046f2e-38e9-5ef9-b288-dac9c52a5f5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA88762',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 58126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-22',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club XL',
 'transmission': 'manual',
 'trim': 'Club XL',
 'year': 2023}
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-28 11:32:44 [auto1.be] INFO: Saving data for KA88762: {'auction_closing_time': 1774716913.0, 'created_time': 1774611086.160765, 'last_price_update_time': 1774697564.562868}
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KA88762') HTTP/1.1" 204 0
2026-03-28 11:32:44 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-28 11:32:44 [auto1.be] INFO: Scrape type for KH63709: 2
2026-03-28 11:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa5cf44f-85cf-574c-9a6a-af491c81ab86 with identifier: KH63709
2026-03-28 11:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa5cf44f-85cf-574c-9a6a-af491c81ab86 with scrape type 2
2026-03-28 11:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa5cf44f-85cf-574c-9a6a-af491c81ab86 with scrape type 2
2026-03-28 11:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aa5cf44f-85cf-574c-9a6a-af491c81ab86, identifier: KH63709
2026-03-28 11:32:44 [auto1.be] INFO: Found listing with ID: BW89679
2026-03-28 11:32:44 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-28 11:32:44 [auto1.be] INFO: Scrape type for XB17770: 2
2026-03-28 11:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5034336-1fbd-51ae-be60-ec6bb35bdc82 with identifier: XB17770
2026-03-28 11:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5034336-1fbd-51ae-be60-ec6bb35bdc82 with scrape type 2
2026-03-28 11:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5034336-1fbd-51ae-be60-ec6bb35bdc82 with scrape type 2
2026-03-28 11:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5034336-1fbd-51ae-be60-ec6bb35bdc82, identifier: XB17770
2026-03-28 11:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aa5cf44f-85cf-574c-9a6a-af491c81ab86 with identifier: KH63709
2026-03-28 11:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aa5cf44f-85cf-574c-9a6a-af491c81ab86 with identifier: KH63709
2026-03-28 11:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aa5cf44f-85cf-574c-9a6a-af491c81ab86 with identifier: KH63709 to the API
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:49:42Z',
 'fuel_type': 'petrol',
 'id': 'aa5cf44f-85cf-574c-9a6a-af491c81ab86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH63709',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 68939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-03',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Business 2WD',
 'transmission': 'automatic',
 'trim': 'Business 2WD',
 'year': 2020}
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-28 11:32:45 [auto1.be] INFO: Saving data for KH63709: {'auction_closing_time': 1774716582.0, 'created_time': 1774611074.870131, 'last_price_update_time': 1774697565.060987}
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KH63709') HTTP/1.1" 204 0
2026-03-28 11:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5034336-1fbd-51ae-be60-ec6bb35bdc82 with identifier: XB17770
2026-03-28 11:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5034336-1fbd-51ae-be60-ec6bb35bdc82 with identifier: XB17770
2026-03-28 11:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5034336-1fbd-51ae-be60-ec6bb35bdc82 with identifier: XB17770 to the API
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-28T16:01:34Z',
 'fuel_type': 'diesel',
 'id': 'c5034336-1fbd-51ae-be60-ec6bb35bdc82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB17770',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 99960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-25',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Momentum Pro AWD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro AWD',
 'year': 2021}
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-28 11:32:45 [auto1.be] INFO: Saving data for XB17770: {'auction_closing_time': 1774713694.0, 'created_time': 1773236499.564429, 'last_price_update_time': 1774697565.350043}
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB17770') HTTP/1.1" 204 0
2026-03-28 11:32:45 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-28 11:32:45 [auto1.be] INFO: Found listing with ID: YL38834
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL38834%27 HTTP/1.1" 200 None
2026-03-28 11:32:45 [auto1.be] INFO: Scrape type for YL38834: 2
2026-03-28 11:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df457952-461f-5c61-b3da-6896d1814d49 with identifier: YL38834
2026-03-28 11:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df457952-461f-5c61-b3da-6896d1814d49 with scrape type 2
2026-03-28 11:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df457952-461f-5c61-b3da-6896d1814d49 with scrape type 2
2026-03-28 11:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: df457952-461f-5c61-b3da-6896d1814d49, identifier: YL38834
2026-03-28 11:32:45 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-28 11:32:45 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-28 11:32:45 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-28 11:32:45 [auto1.be] INFO: Scrape type for LP07116: 2
2026-03-28 11:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with identifier: LP07116
2026-03-28 11:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with scrape type 2
2026-03-28 11:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with scrape type 2
2026-03-28 11:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1, identifier: LP07116
2026-03-28 11:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: df457952-461f-5c61-b3da-6896d1814d49 with identifier: YL38834
2026-03-28 11:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: df457952-461f-5c61-b3da-6896d1814d49 with identifier: YL38834
2026-03-28 11:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: df457952-461f-5c61-b3da-6896d1814d49 with identifier: YL38834 to the API
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:41:43Z',
 'fuel_type': 'petrol',
 'id': 'df457952-461f-5c61-b3da-6896d1814d49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL38834',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 56823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-03',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Roland Garros',
 'transmission': 'manual',
 'trim': 'Roland Garros',
 'year': 2011}
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL38834%27 HTTP/1.1" 200 None
2026-03-28 11:32:45 [auto1.be] INFO: Saving data for YL38834: {'auction_closing_time': 1774716103.0, 'created_time': 1774611064.729052, 'last_price_update_time': 1774697565.832098}
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YL38834') HTTP/1.1" 204 0
2026-03-28 11:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with identifier: LP07116
2026-03-28 11:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with identifier: LP07116
2026-03-28 11:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with identifier: LP07116 to the API
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:08:18Z',
 'fuel_type': 'diesel',
 'id': 'b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP07116',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 189459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-10',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2013}
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-28 11:32:46 [auto1.be] INFO: Saving data for LP07116: {'auction_closing_time': 1774714098.0, 'created_time': 1774611102.982642, 'last_price_update_time': 1774697566.109022}
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP07116') HTTP/1.1" 204 0
2026-03-28 11:32:46 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-28 11:32:46 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-28 11:32:46 [auto1.be] INFO: Scrape type for MW76341: 2
2026-03-28 11:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12f0e405-d36b-5478-8141-bf8484dde994 with identifier: MW76341
2026-03-28 11:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12f0e405-d36b-5478-8141-bf8484dde994 with scrape type 2
2026-03-28 11:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12f0e405-d36b-5478-8141-bf8484dde994 with scrape type 2
2026-03-28 11:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12f0e405-d36b-5478-8141-bf8484dde994, identifier: MW76341
2026-03-28 11:32:46 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-28 11:32:46 [auto1.be] INFO: Scrape type for CE65833: 2
2026-03-28 11:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with identifier: CE65833
2026-03-28 11:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with scrape type 2
2026-03-28 11:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with scrape type 2
2026-03-28 11:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f, identifier: CE65833
2026-03-28 11:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12f0e405-d36b-5478-8141-bf8484dde994 with identifier: MW76341
2026-03-28 11:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12f0e405-d36b-5478-8141-bf8484dde994 with identifier: MW76341
2026-03-28 11:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12f0e405-d36b-5478-8141-bf8484dde994 with identifier: MW76341 to the API
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:52:17Z',
 'fuel_type': 'petrol',
 'id': '12f0e405-d36b-5478-8141-bf8484dde994',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW76341',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 64488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-28 11:32:46 [auto1.be] INFO: Saving data for MW76341: {'auction_closing_time': 1774716737.0, 'created_time': 1774611059.375446, 'last_price_update_time': 1774697566.623733}
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MW76341') HTTP/1.1" 204 0
2026-03-28 11:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with identifier: CE65833
2026-03-28 11:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with identifier: CE65833
2026-03-28 11:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with identifier: CE65833 to the API
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-28T16:14:40Z',
 'fuel_type': 'petrol',
 'id': 'a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE65833',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 218199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV Motion 4WD',
 'transmission': 'automatic',
 'trim': 'Motion 4WD',
 'year': 2015}
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-28 11:32:47 [auto1.be] INFO: Saving data for CE65833: {'auction_closing_time': 1774714480.0, 'created_time': 1774611096.059278, 'last_price_update_time': 1774697567.06441}
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE65833') HTTP/1.1" 204 0
2026-03-28 11:32:47 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-28 11:32:47 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-28 11:32:47 [auto1.be] INFO: Scrape type for GF63829: 2
2026-03-28 11:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da83eef-9ce5-50b7-b5f9-8652db35b71c with identifier: GF63829
2026-03-28 11:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da83eef-9ce5-50b7-b5f9-8652db35b71c with scrape type 2
2026-03-28 11:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5da83eef-9ce5-50b7-b5f9-8652db35b71c with scrape type 2
2026-03-28 11:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5da83eef-9ce5-50b7-b5f9-8652db35b71c, identifier: GF63829
2026-03-28 11:32:47 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-28 11:32:47 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-28 11:32:47 [auto1.be] INFO: Scrape type for VP78411: 2
2026-03-28 11:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9863b681-833e-52f6-b759-532c5c256fc7 with identifier: VP78411
2026-03-28 11:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9863b681-833e-52f6-b759-532c5c256fc7 with scrape type 2
2026-03-28 11:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9863b681-833e-52f6-b759-532c5c256fc7 with scrape type 2
2026-03-28 11:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9863b681-833e-52f6-b759-532c5c256fc7, identifier: VP78411
2026-03-28 11:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5da83eef-9ce5-50b7-b5f9-8652db35b71c with identifier: GF63829
2026-03-28 11:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5da83eef-9ce5-50b7-b5f9-8652db35b71c with identifier: GF63829
2026-03-28 11:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5da83eef-9ce5-50b7-b5f9-8652db35b71c with identifier: GF63829 to the API
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:36:44Z',
 'fuel_type': 'diesel',
 'id': '5da83eef-9ce5-50b7-b5f9-8652db35b71c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF63829',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 201432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-29',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Ocean Race',
 'transmission': 'manual',
 'trim': 'Ocean Race',
 'year': 2015}
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-28 11:32:47 [auto1.be] INFO: Saving data for GF63829: {'auction_closing_time': 1774715804.0, 'created_time': 1774611056.956269, 'last_price_update_time': 1774697567.549549}
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF63829') HTTP/1.1" 204 0
2026-03-28 11:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9863b681-833e-52f6-b759-532c5c256fc7 with identifier: VP78411
2026-03-28 11:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9863b681-833e-52f6-b759-532c5c256fc7 with identifier: VP78411
2026-03-28 11:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9863b681-833e-52f6-b759-532c5c256fc7 with identifier: VP78411 to the API
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:09:32Z',
 'fuel_type': 'gas',
 'id': '9863b681-833e-52f6-b759-532c5c256fc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP78411',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 43853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-01',
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe LPG Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2021}
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-28 11:32:47 [auto1.be] INFO: Saving data for VP78411: {'auction_closing_time': 1774714172.0, 'created_time': 1774611096.395572, 'last_price_update_time': 1774697567.828751}
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP78411') HTTP/1.1" 204 0
2026-03-28 11:32:47 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-28 11:32:47 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-28 11:32:47 [auto1.be] INFO: Scrape type for SC04496: 2
2026-03-28 11:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c99fa020-c354-5391-9f85-b5505442b785 with identifier: SC04496
2026-03-28 11:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99fa020-c354-5391-9f85-b5505442b785 with scrape type 2
2026-03-28 11:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c99fa020-c354-5391-9f85-b5505442b785 with scrape type 2
2026-03-28 11:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c99fa020-c354-5391-9f85-b5505442b785, identifier: SC04496
2026-03-28 11:32:47 [auto1.be] INFO: Found listing with ID: KV58178
2026-03-28 11:32:47 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-28 11:32:47 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-28 11:32:47 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-28 11:32:47 [auto1.be] INFO: Scrape type for HB98543: 2
2026-03-28 11:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c88ce288-a0c0-5486-997d-d0961638670b with identifier: HB98543
2026-03-28 11:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c88ce288-a0c0-5486-997d-d0961638670b with scrape type 2
2026-03-28 11:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c88ce288-a0c0-5486-997d-d0961638670b with scrape type 2
2026-03-28 11:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c88ce288-a0c0-5486-997d-d0961638670b, identifier: HB98543
2026-03-28 11:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c99fa020-c354-5391-9f85-b5505442b785 with identifier: SC04496
2026-03-28 11:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c99fa020-c354-5391-9f85-b5505442b785 with identifier: SC04496
2026-03-28 11:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c99fa020-c354-5391-9f85-b5505442b785 with identifier: SC04496 to the API
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:46:58Z',
 'fuel_type': 'diesel',
 'id': 'c99fa020-c354-5391-9f85-b5505442b785',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC04496',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 167902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-25',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2009}
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-28 11:32:48 [auto1.be] INFO: Saving data for SC04496: {'auction_closing_time': 1774716418.0, 'created_time': 1774611055.380757, 'last_price_update_time': 1774697568.374258}
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC04496') HTTP/1.1" 204 0
2026-03-28 11:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c88ce288-a0c0-5486-997d-d0961638670b with identifier: HB98543
2026-03-28 11:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c88ce288-a0c0-5486-997d-d0961638670b with identifier: HB98543
2026-03-28 11:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c88ce288-a0c0-5486-997d-d0961638670b with identifier: HB98543 to the API
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:00:12Z',
 'fuel_type': 'diesel',
 'id': 'c88ce288-a0c0-5486-997d-d0961638670b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB98543',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 171169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI 120 Jahre Start/Stop',
 'transmission': 'manual',
 'trim': '120 Jahre Start/Stop',
 'year': 2019}
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-28 11:32:48 [auto1.be] INFO: Saving data for HB98543: {'auction_closing_time': 1774713612.0, 'created_time': 1773693735.531847, 'last_price_update_time': 1774697568.651365}
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HB98543') HTTP/1.1" 204 0
2026-03-28 11:32:48 [auto1.be] INFO: Found listing with ID: UY90554
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY90554%27 HTTP/1.1" 200 None
2026-03-28 11:32:48 [auto1.be] INFO: Scrape type for UY90554: 2
2026-03-28 11:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 437510ac-2e07-5f9c-b489-10eefff69712 with identifier: UY90554
2026-03-28 11:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 437510ac-2e07-5f9c-b489-10eefff69712 with scrape type 2
2026-03-28 11:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 437510ac-2e07-5f9c-b489-10eefff69712 with scrape type 2
2026-03-28 11:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 437510ac-2e07-5f9c-b489-10eefff69712, identifier: UY90554
2026-03-28 11:32:48 [auto1.be] INFO: Found listing with ID: JX31629
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX31629%27 HTTP/1.1" 200 None
2026-03-28 11:32:48 [auto1.be] INFO: Scrape type for JX31629: 2
2026-03-28 11:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf with identifier: JX31629
2026-03-28 11:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf with scrape type 2
2026-03-28 11:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf with scrape type 2
2026-03-28 11:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf, identifier: JX31629
2026-03-28 11:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 437510ac-2e07-5f9c-b489-10eefff69712 with identifier: UY90554
2026-03-28 11:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 437510ac-2e07-5f9c-b489-10eefff69712 with identifier: UY90554
2026-03-28 11:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 437510ac-2e07-5f9c-b489-10eefff69712 with identifier: UY90554 to the API
2026-03-28 11:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:34:14Z',
 'fuel_type': 'diesel',
 'id': '437510ac-2e07-5f9c-b489-10eefff69712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY90554',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 140649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-17',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2014}
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY90554%27 HTTP/1.1" 200 None
2026-03-28 11:32:49 [auto1.be] INFO: Saving data for UY90554: {'auction_closing_time': 1774715654.0, 'created_time': 1773434067.320428, 'last_price_update_time': 1774697569.122274}
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY90554') HTTP/1.1" 204 0
2026-03-28 11:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf with identifier: JX31629
2026-03-28 11:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf with identifier: JX31629
2026-03-28 11:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3efe0c89-cea8-5cd9-b31a-ebb930eb51bf with identifier: JX31629 to the API
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:00:44Z',
 'fuel_type': 'diesel',
 'id': '3efe0c89-cea8-5cd9-b31a-ebb930eb51bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX31629',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 79741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-19',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2014}
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX31629%27 HTTP/1.1" 200 None
2026-03-28 11:32:49 [auto1.be] INFO: Saving data for JX31629: {'auction_closing_time': 1774713644.0, 'created_time': 1774471383.188003, 'last_price_update_time': 1774697569.49026}
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX31629') HTTP/1.1" 204 0
2026-03-28 11:32:49 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-28 11:32:49 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-28 11:32:49 [auto1.be] INFO: Scrape type for GW63299: 2
2026-03-28 11:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dddbf5c-4eb8-53ae-8520-608843c459ab with identifier: GW63299
2026-03-28 11:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dddbf5c-4eb8-53ae-8520-608843c459ab with scrape type 2
2026-03-28 11:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dddbf5c-4eb8-53ae-8520-608843c459ab with scrape type 2
2026-03-28 11:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3dddbf5c-4eb8-53ae-8520-608843c459ab, identifier: GW63299
2026-03-28 11:32:49 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-28 11:32:49 [auto1.be] INFO: Scrape type for UU07035: 2
2026-03-28 11:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee4c9849-e711-542c-a3e1-3623346b18d0 with identifier: UU07035
2026-03-28 11:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4c9849-e711-542c-a3e1-3623346b18d0 with scrape type 2
2026-03-28 11:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee4c9849-e711-542c-a3e1-3623346b18d0 with scrape type 2
2026-03-28 11:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee4c9849-e711-542c-a3e1-3623346b18d0, identifier: UU07035
2026-03-28 11:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3dddbf5c-4eb8-53ae-8520-608843c459ab with identifier: GW63299
2026-03-28 11:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3dddbf5c-4eb8-53ae-8520-608843c459ab with identifier: GW63299
2026-03-28 11:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3dddbf5c-4eb8-53ae-8520-608843c459ab with identifier: GW63299 to the API
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:37:31Z',
 'fuel_type': 'petrol',
 'id': '3dddbf5c-4eb8-53ae-8520-608843c459ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW63299',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 118194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-08',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-28 11:32:49 [auto1.be] INFO: Saving data for GW63299: {'auction_closing_time': 1774715851.0, 'created_time': 1774611058.362266, 'last_price_update_time': 1774697569.956999}
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GW63299') HTTP/1.1" 204 0
2026-03-28 11:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee4c9849-e711-542c-a3e1-3623346b18d0 with identifier: UU07035
2026-03-28 11:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee4c9849-e711-542c-a3e1-3623346b18d0 with identifier: UU07035
2026-03-28 11:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee4c9849-e711-542c-a3e1-3623346b18d0 with identifier: UU07035 to the API
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:00:39Z',
 'fuel_type': 'petrol',
 'id': 'ee4c9849-e711-542c-a3e1-3623346b18d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU07035',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 204364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-15',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2013}
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-28 11:32:50 [auto1.be] INFO: Saving data for UU07035: {'auction_closing_time': 1774713639.0, 'created_time': 1773693340.499912, 'last_price_update_time': 1774697570.23322}
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UU07035') HTTP/1.1" 204 0
2026-03-28 11:32:50 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-28 11:32:50 [auto1.be] INFO: Scrape type for MC66522: 2
2026-03-28 11:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 392a769e-bb78-5699-a29f-f5922d2d40b0 with identifier: MC66522
2026-03-28 11:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 392a769e-bb78-5699-a29f-f5922d2d40b0 with scrape type 2
2026-03-28 11:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 392a769e-bb78-5699-a29f-f5922d2d40b0 with scrape type 2
2026-03-28 11:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 392a769e-bb78-5699-a29f-f5922d2d40b0, identifier: MC66522
2026-03-28 11:32:50 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-28 11:32:50 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-28 11:32:50 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-28 11:32:50 [auto1.be] INFO: Scrape type for YK80434: 2
2026-03-28 11:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c828c7e-bbca-5656-b090-1d8e5810870d with identifier: YK80434
2026-03-28 11:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c828c7e-bbca-5656-b090-1d8e5810870d with scrape type 2
2026-03-28 11:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c828c7e-bbca-5656-b090-1d8e5810870d with scrape type 2
2026-03-28 11:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c828c7e-bbca-5656-b090-1d8e5810870d, identifier: YK80434
2026-03-28 11:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 392a769e-bb78-5699-a29f-f5922d2d40b0 with identifier: MC66522
2026-03-28 11:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 392a769e-bb78-5699-a29f-f5922d2d40b0 with identifier: MC66522
2026-03-28 11:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 392a769e-bb78-5699-a29f-f5922d2d40b0 with identifier: MC66522 to the API
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:12:28Z',
 'fuel_type': 'diesel',
 'id': '392a769e-bb78-5699-a29f-f5922d2d40b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC66522',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 143399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-18',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi Comfort Blue 2WD',
 'transmission': 'manual',
 'trim': 'Comfort Blue 2WD',
 'year': 2012}
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-28 11:32:50 [auto1.be] INFO: Saving data for MC66522: {'auction_closing_time': 1774714348.0, 'created_time': 1774611065.508958, 'last_price_update_time': 1774697570.70852}
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MC66522') HTTP/1.1" 204 0
2026-03-28 11:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c828c7e-bbca-5656-b090-1d8e5810870d with identifier: YK80434
2026-03-28 11:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c828c7e-bbca-5656-b090-1d8e5810870d with identifier: YK80434
2026-03-28 11:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c828c7e-bbca-5656-b090-1d8e5810870d with identifier: YK80434 to the API
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:09:07Z',
 'fuel_type': 'petrol',
 'id': '8c828c7e-bbca-5656-b090-1d8e5810870d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK80434',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 62610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-31',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2010}
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-28 11:32:50 [auto1.be] INFO: Saving data for YK80434: {'auction_closing_time': 1774714147.0, 'created_time': 1774611126.069394, 'last_price_update_time': 1774697570.997056}
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YK80434') HTTP/1.1" 204 0
2026-03-28 11:32:51 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-28 11:32:51 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-28 11:32:51 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-28 11:32:51 [auto1.be] INFO: Scrape type for RN56335: 2
2026-03-28 11:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffa4faba-ccce-55c8-9119-c95e844fbfbe with identifier: RN56335
2026-03-28 11:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffa4faba-ccce-55c8-9119-c95e844fbfbe with scrape type 2
2026-03-28 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffa4faba-ccce-55c8-9119-c95e844fbfbe with scrape type 2
2026-03-28 11:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ffa4faba-ccce-55c8-9119-c95e844fbfbe, identifier: RN56335
2026-03-28 11:32:51 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-28 11:32:51 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-28 11:32:51 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-28 11:32:51 [auto1.be] INFO: Scrape type for GF65026: 0
2026-03-28 11:32:51 [auto1.be] INFO: Found listing with ID: UN53703
2026-03-28 11:32:51 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-28 11:32:51 [auto1.be] INFO: Scrape type for WF76478: 2
2026-03-28 11:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with identifier: WF76478
2026-03-28 11:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with scrape type 2
2026-03-28 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with scrape type 2
2026-03-28 11:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0ab1be6-e265-5fb1-9dbe-7ece245189a2, identifier: WF76478
2026-03-28 11:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ffa4faba-ccce-55c8-9119-c95e844fbfbe with identifier: RN56335
2026-03-28 11:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ffa4faba-ccce-55c8-9119-c95e844fbfbe with identifier: RN56335
2026-03-28 11:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ffa4faba-ccce-55c8-9119-c95e844fbfbe with identifier: RN56335 to the API
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:23:12Z',
 'fuel_type': 'petrol',
 'id': 'ffa4faba-ccce-55c8-9119-c95e844fbfbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN56335',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 105536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-25',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-28 11:32:51 [auto1.be] INFO: Saving data for RN56335: {'auction_closing_time': 1774714992.0, 'created_time': 1774611062.534552, 'last_price_update_time': 1774697571.506944}
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RN56335') HTTP/1.1" 204 0
2026-03-28 11:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with identifier: WF76478
2026-03-28 11:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with identifier: WF76478
2026-03-28 11:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with identifier: WF76478 to the API
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:12:10Z',
 'fuel_type': 'diesel',
 'id': 'c0ab1be6-e265-5fb1-9dbe-7ece245189a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF76478',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60 Cross Country',
 'odometer': 34223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-04',
 'seller_name': None,
 'title': 'Volvo S60 Cross Country 2.0 D4 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2016}
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-28 11:32:51 [auto1.be] INFO: Saving data for WF76478: {'auction_closing_time': 1774714330.0, 'created_time': 1774298004.937259, 'last_price_update_time': 1774697571.856956}
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WF76478') HTTP/1.1" 204 0
2026-03-28 11:32:51 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-28 11:32:51 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-28 11:32:51 [auto1.be] INFO: Scrape type for ZK51965: 2
2026-03-28 11:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with identifier: ZK51965
2026-03-28 11:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with scrape type 2
2026-03-28 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with scrape type 2
2026-03-28 11:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a, identifier: ZK51965
2026-03-28 11:32:51 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-28 11:32:51 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-28 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-28 11:32:52 [auto1.be] INFO: Scrape type for AL21659: 2
2026-03-28 11:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1c24096-f6d3-501f-a13d-66288782ee38 with identifier: AL21659
2026-03-28 11:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1c24096-f6d3-501f-a13d-66288782ee38 with scrape type 2
2026-03-28 11:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1c24096-f6d3-501f-a13d-66288782ee38 with scrape type 2
2026-03-28 11:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b1c24096-f6d3-501f-a13d-66288782ee38, identifier: AL21659
2026-03-28 11:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with identifier: ZK51965
2026-03-28 11:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with identifier: ZK51965
2026-03-28 11:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with identifier: ZK51965 to the API
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:38:27Z',
 'fuel_type': 'diesel',
 'id': '4fd9ad0a-1898-5ffe-bb37-005a1e46345a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK51965',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 249855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-28',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-28 11:32:52 [auto1.be] INFO: Saving data for ZK51965: {'auction_closing_time': 1774715907.0, 'created_time': 1773661632.6523, 'last_price_update_time': 1774697572.343344}
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZK51965') HTTP/1.1" 204 0
2026-03-28 11:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b1c24096-f6d3-501f-a13d-66288782ee38 with identifier: AL21659
2026-03-28 11:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b1c24096-f6d3-501f-a13d-66288782ee38 with identifier: AL21659
2026-03-28 11:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b1c24096-f6d3-501f-a13d-66288782ee38 with identifier: AL21659 to the API
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:21:21Z',
 'fuel_type': 'petrol',
 'id': 'b1c24096-f6d3-501f-a13d-66288782ee38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL21659',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 130607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-24',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-28 11:32:52 [auto1.be] INFO: Saving data for AL21659: {'auction_closing_time': 1774714881.0, 'created_time': 1773133726.398531, 'last_price_update_time': 1774697572.652198}
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AL21659') HTTP/1.1" 204 0
2026-03-28 11:32:52 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-28 11:32:52 [auto1.be] INFO: Scrape type for MS23670: 2
2026-03-28 11:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with identifier: MS23670
2026-03-28 11:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with scrape type 2
2026-03-28 11:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with scrape type 2
2026-03-28 11:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e4dbaf1-f583-5eb7-8003-503b2df93d53, identifier: MS23670
2026-03-28 11:32:52 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-28 11:32:52 [auto1.be] INFO: Scrape type for SC36479: 2
2026-03-28 11:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with identifier: SC36479
2026-03-28 11:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with scrape type 2
2026-03-28 11:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with scrape type 2
2026-03-28 11:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c20e58cc-3c8a-5caf-80e0-d82acc0d8396, identifier: SC36479
2026-03-28 11:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with identifier: MS23670
2026-03-28 11:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with identifier: MS23670
2026-03-28 11:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with identifier: MS23670 to the API
2026-03-28 11:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:14:53Z',
 'fuel_type': 'diesel',
 'id': '7e4dbaf1-f583-5eb7-8003-503b2df93d53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS23670',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 243700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-19',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi TD Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-28 11:32:53 [auto1.be] INFO: Saving data for MS23670: {'auction_closing_time': 1774714493.0, 'created_time': 1774611101.485819, 'last_price_update_time': 1774697573.168569}
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MS23670') HTTP/1.1" 204 0
2026-03-28 11:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with identifier: SC36479
2026-03-28 11:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with identifier: SC36479
2026-03-28 11:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with identifier: SC36479 to the API
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:09:47Z',
 'fuel_type': 'diesel',
 'id': 'c20e58cc-3c8a-5caf-80e0-d82acc0d8396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC36479',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 58037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-08',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-28 11:32:53 [auto1.be] INFO: Saving data for SC36479: {'auction_closing_time': 1774714187.0, 'created_time': 1774611103.323744, 'last_price_update_time': 1774697573.44847}
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC36479') HTTP/1.1" 204 0
2026-03-28 11:32:53 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-28 11:32:53 [auto1.be] INFO: Scrape type for DC17534: 2
2026-03-28 11:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with identifier: DC17534
2026-03-28 11:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with scrape type 2
2026-03-28 11:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with scrape type 2
2026-03-28 11:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66, identifier: DC17534
2026-03-28 11:32:53 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-28 11:32:53 [auto1.be] INFO: Scrape type for JX62848: 2
2026-03-28 11:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b09b911-677d-5afc-ad0b-4221d98ef428 with identifier: JX62848
2026-03-28 11:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b09b911-677d-5afc-ad0b-4221d98ef428 with scrape type 2
2026-03-28 11:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b09b911-677d-5afc-ad0b-4221d98ef428 with scrape type 2
2026-03-28 11:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2b09b911-677d-5afc-ad0b-4221d98ef428, identifier: JX62848
2026-03-28 11:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with identifier: DC17534
2026-03-28 11:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with identifier: DC17534
2026-03-28 11:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with identifier: DC17534 to the API
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:07:21Z',
 'fuel_type': 'petrol',
 'id': '4debd35f-e5d5-5c62-80d3-2312a6fc1a66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC17534',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 216832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-28 11:32:53 [auto1.be] INFO: Saving data for DC17534: {'auction_closing_time': 1774714041.0, 'created_time': 1774611085.773547, 'last_price_update_time': 1774697573.940288}
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DC17534') HTTP/1.1" 204 0
2026-03-28 11:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2b09b911-677d-5afc-ad0b-4221d98ef428 with identifier: JX62848
2026-03-28 11:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2b09b911-677d-5afc-ad0b-4221d98ef428 with identifier: JX62848
2026-03-28 11:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2b09b911-677d-5afc-ad0b-4221d98ef428 with identifier: JX62848 to the API
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:24:31Z',
 'fuel_type': 'diesel',
 'id': '2b09b911-677d-5afc-ad0b-4221d98ef428',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX62848',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 129400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi L2 Sport',
 'transmission': 'automatic',
 'trim': 'L2 Sport',
 'year': 2020}
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-28 11:32:54 [auto1.be] INFO: Saving data for JX62848: {'auction_closing_time': 1774715071.0, 'created_time': 1774297878.045573, 'last_price_update_time': 1774697574.22192}
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX62848') HTTP/1.1" 204 0
2026-03-28 11:32:54 [auto1.be] INFO: Channel: 24h | Page: 42 | totalHits: 1816 | hits on page: 40
2026-03-28 11:32:54 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-28 11:32:54 [auto1.be] INFO: Scrape type for EJ45470: 2
2026-03-28 11:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f698588d-2208-571b-89b2-8b3c37f75c1d with identifier: EJ45470
2026-03-28 11:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f698588d-2208-571b-89b2-8b3c37f75c1d with scrape type 2
2026-03-28 11:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f698588d-2208-571b-89b2-8b3c37f75c1d with scrape type 2
2026-03-28 11:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f698588d-2208-571b-89b2-8b3c37f75c1d, identifier: EJ45470
2026-03-28 11:32:54 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-28 11:32:54 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-28 11:32:54 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-28 11:32:54 [auto1.be] INFO: Scrape type for DY20434: 2
2026-03-28 11:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with identifier: DY20434
2026-03-28 11:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with scrape type 2
2026-03-28 11:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with scrape type 2
2026-03-28 11:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4, identifier: DY20434
2026-03-28 11:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f698588d-2208-571b-89b2-8b3c37f75c1d with identifier: EJ45470
2026-03-28 11:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f698588d-2208-571b-89b2-8b3c37f75c1d with identifier: EJ45470
2026-03-28 11:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f698588d-2208-571b-89b2-8b3c37f75c1d with identifier: EJ45470 to the API
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:17:22Z',
 'fuel_type': 'petrol',
 'id': 'f698588d-2208-571b-89b2-8b3c37f75c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ45470',
 'listing': 'auction',
 'make': 'Porsche',
 'model': '911',
 'odometer': 90880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1975-08-27',
 'seller_name': None,
 'title': 'Porsche 911 G-Modell 2.7 Coupe',
 'transmission': 'manual',
 'trim': '2.7 Coupe',
 'year': 1975}
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-28 11:32:54 [auto1.be] INFO: Saving data for EJ45470: {'auction_closing_time': 1774714642.0, 'created_time': 1773921077.804371, 'last_price_update_time': 1774697574.713199}
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EJ45470') HTTP/1.1" 204 0
2026-03-28 11:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with identifier: DY20434
2026-03-28 11:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with identifier: DY20434
2026-03-28 11:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with identifier: DY20434 to the API
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:29:21Z',
 'fuel_type': 'petrol',
 'id': 'e80a2ae7-c135-5e4f-9d8c-521e8283a6c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY20434',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 62028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Crossway',
 'transmission': 'automatic',
 'trim': 'Crossway',
 'year': 2018}
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-28 11:32:55 [auto1.be] INFO: Saving data for DY20434: {'auction_closing_time': 1774715361.0, 'created_time': 1773134852.990224, 'last_price_update_time': 1774697575.088765}
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY20434') HTTP/1.1" 204 0
2026-03-28 11:32:55 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-28 11:32:55 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-28 11:32:55 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-28 11:32:55 [auto1.be] INFO: Scrape type for JW58136: 2
2026-03-28 11:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c612b540-cffb-5a85-a102-e56dce025061 with identifier: JW58136
2026-03-28 11:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c612b540-cffb-5a85-a102-e56dce025061 with scrape type 2
2026-03-28 11:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c612b540-cffb-5a85-a102-e56dce025061 with scrape type 2
2026-03-28 11:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c612b540-cffb-5a85-a102-e56dce025061, identifier: JW58136
2026-03-28 11:32:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:32:55 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-28 11:32:55 [auto1.be] INFO: Scrape type for TU11660: 2
2026-03-28 11:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with identifier: TU11660
2026-03-28 11:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with scrape type 2
2026-03-28 11:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with scrape type 2
2026-03-28 11:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b75bf36-de36-5b83-9cc7-5682f55ecc50, identifier: TU11660
2026-03-28 11:32:55 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-28 11:32:55 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-28 11:32:55 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-28 11:32:55 [auto1.be] INFO: Scrape type for JH02802: 2
2026-03-28 11:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5532df08-5d66-51db-a9ec-fec0f4890556 with identifier: JH02802
2026-03-28 11:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5532df08-5d66-51db-a9ec-fec0f4890556 with scrape type 2
2026-03-28 11:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5532df08-5d66-51db-a9ec-fec0f4890556 with scrape type 2
2026-03-28 11:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5532df08-5d66-51db-a9ec-fec0f4890556, identifier: JH02802
2026-03-28 11:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c612b540-cffb-5a85-a102-e56dce025061 with identifier: JW58136
2026-03-28 11:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c612b540-cffb-5a85-a102-e56dce025061 with identifier: JW58136
2026-03-28 11:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c612b540-cffb-5a85-a102-e56dce025061 with identifier: JW58136 to the API
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:35:39Z',
 'fuel_type': 'petrol',
 'id': 'c612b540-cffb-5a85-a102-e56dce025061',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW58136',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 171197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-02',
 'seller_name': None,
 'title': 'Chevrolet Cruze 1.8 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2010}
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-28 11:32:55 [auto1.be] INFO: Saving data for JW58136: {'auction_closing_time': 1774715739.0, 'created_time': 1773135663.676924, 'last_price_update_time': 1774697575.676193}
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW58136') HTTP/1.1" 204 0
2026-03-28 11:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with identifier: TU11660
2026-03-28 11:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with identifier: TU11660
2026-03-28 11:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with identifier: TU11660 to the API
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:08:35Z',
 'fuel_type': 'diesel',
 'id': '1b75bf36-de36-5b83-9cc7-5682f55ecc50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU11660',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 34729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-02',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-28 11:32:55 [auto1.be] INFO: Saving data for TU11660: {'auction_closing_time': 1774714115.0, 'created_time': 1773402051.640117, 'last_price_update_time': 1774697575.95431}
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU11660') HTTP/1.1" 204 0
2026-03-28 11:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5532df08-5d66-51db-a9ec-fec0f4890556 with identifier: JH02802
2026-03-28 11:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5532df08-5d66-51db-a9ec-fec0f4890556 with identifier: JH02802
2026-03-28 11:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5532df08-5d66-51db-a9ec-fec0f4890556 with identifier: JH02802 to the API
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:36:44Z',
 'fuel_type': 'gas',
 'id': '5532df08-5d66-51db-a9ec-fec0f4890556',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH02802',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 258891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TGI Maxi Kasten BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Kasten BlueMotion',
 'year': 2017}
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-28 11:32:56 [auto1.be] INFO: Saving data for JH02802: {'auction_closing_time': 1774715804.0, 'created_time': 1774265461.649245, 'last_price_update_time': 1774697576.232065}
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JH02802') HTTP/1.1" 204 0
2026-03-28 11:32:56 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-28 11:32:56 [auto1.be] INFO: Scrape type for DG02903: 2
2026-03-28 11:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a91a79f4-ed15-5009-a9b5-f1581580341f with identifier: DG02903
2026-03-28 11:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91a79f4-ed15-5009-a9b5-f1581580341f with scrape type 2
2026-03-28 11:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a91a79f4-ed15-5009-a9b5-f1581580341f with scrape type 2
2026-03-28 11:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a91a79f4-ed15-5009-a9b5-f1581580341f, identifier: DG02903
2026-03-28 11:32:56 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-28 11:32:56 [auto1.be] INFO: Found listing with ID: JH99432
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH99432%27 HTTP/1.1" 200 None
2026-03-28 11:32:56 [auto1.be] INFO: Scrape type for JH99432: 2
2026-03-28 11:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eb3dd54-fd54-5817-846f-028d5cf23468 with identifier: JH99432
2026-03-28 11:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eb3dd54-fd54-5817-846f-028d5cf23468 with scrape type 2
2026-03-28 11:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eb3dd54-fd54-5817-846f-028d5cf23468 with scrape type 2
2026-03-28 11:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6eb3dd54-fd54-5817-846f-028d5cf23468, identifier: JH99432
2026-03-28 11:32:56 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-28 11:32:56 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-28 11:32:56 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-28 11:32:56 [auto1.be] INFO: Scrape type for LW38679: 2
2026-03-28 11:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with identifier: LW38679
2026-03-28 11:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with scrape type 2
2026-03-28 11:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with scrape type 2
2026-03-28 11:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9, identifier: LW38679
2026-03-28 11:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a91a79f4-ed15-5009-a9b5-f1581580341f with identifier: DG02903
2026-03-28 11:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a91a79f4-ed15-5009-a9b5-f1581580341f with identifier: DG02903
2026-03-28 11:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a91a79f4-ed15-5009-a9b5-f1581580341f with identifier: DG02903 to the API
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:33:11Z',
 'fuel_type': 'diesel',
 'id': 'a91a79f4-ed15-5009-a9b5-f1581580341f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG02903',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 212303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-08',
 'seller_name': None,
 'title': 'BMW 3er 330d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-28 11:32:56 [auto1.be] INFO: Saving data for DG02903: {'auction_closing_time': 1774715591.0, 'created_time': 1773136052.126911, 'last_price_update_time': 1774697576.957238}
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DG02903') HTTP/1.1" 204 0
2026-03-28 11:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6eb3dd54-fd54-5817-846f-028d5cf23468 with identifier: JH99432
2026-03-28 11:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6eb3dd54-fd54-5817-846f-028d5cf23468 with identifier: JH99432
2026-03-28 11:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6eb3dd54-fd54-5817-846f-028d5cf23468 with identifier: JH99432 to the API
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:05:02Z',
 'fuel_type': 'petrol',
 'id': '6eb3dd54-fd54-5817-846f-028d5cf23468',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH99432',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 112523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-22',
 'seller_name': None,
 'title': 'BMW 6er 650 CI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH99432%27 HTTP/1.1" 200 None
2026-03-28 11:32:57 [auto1.be] INFO: Saving data for JH99432: {'auction_closing_time': 1774713902.0, 'created_time': 1774611092.275216, 'last_price_update_time': 1774697577.325635}
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JH99432') HTTP/1.1" 204 0
2026-03-28 11:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with identifier: LW38679
2026-03-28 11:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with identifier: LW38679
2026-03-28 11:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with identifier: LW38679 to the API
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:27:27Z',
 'fuel_type': 'diesel',
 'id': '1b40f512-5bf0-5bfd-8594-c6ae5f4faad9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW38679',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 225826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-23',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.3 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2006}
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-28 11:32:57 [auto1.be] INFO: Saving data for LW38679: {'auction_closing_time': 1774715247.0, 'created_time': 1774125133.712567, 'last_price_update_time': 1774697577.611658}
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LW38679') HTTP/1.1" 204 0
2026-03-28 11:32:57 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-28 11:32:57 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-28 11:32:57 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-28 11:32:57 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-28 11:32:57 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-28 11:32:57 [auto1.be] INFO: Scrape type for FM00077: 0
2026-03-28 11:32:57 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-28 11:32:57 [auto1.be] INFO: Scrape type for KP74596: 0
2026-03-28 11:32:57 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-28 11:32:57 [auto1.be] INFO: Scrape type for PB67516: 0
2026-03-28 11:32:57 [auto1.be] INFO: Found listing with ID: YJ60132
2026-03-28 11:32:57 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-28 11:32:57 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-28 11:32:57 [auto1.be] INFO: Scrape type for FC28046: 2
2026-03-28 11:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d1dadde-b25e-5539-ac33-ae3b015b70af with identifier: FC28046
2026-03-28 11:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d1dadde-b25e-5539-ac33-ae3b015b70af with scrape type 2
2026-03-28 11:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d1dadde-b25e-5539-ac33-ae3b015b70af with scrape type 2
2026-03-28 11:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d1dadde-b25e-5539-ac33-ae3b015b70af, identifier: FC28046
2026-03-28 11:32:57 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-28 11:32:57 [auto1.be] INFO: Found listing with ID: PY40839
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY40839%27 HTTP/1.1" 200 None
2026-03-28 11:32:57 [auto1.be] INFO: Scrape type for PY40839: 2
2026-03-28 11:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1e21240-1b44-58dd-835a-320d5a3a7f2b with identifier: PY40839
2026-03-28 11:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e21240-1b44-58dd-835a-320d5a3a7f2b with scrape type 2
2026-03-28 11:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1e21240-1b44-58dd-835a-320d5a3a7f2b with scrape type 2
2026-03-28 11:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b1e21240-1b44-58dd-835a-320d5a3a7f2b, identifier: PY40839
2026-03-28 11:32:57 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-28 11:32:57 [auto1.be] INFO: Scrape type for MV28568: 2
2026-03-28 11:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0151fb6-a780-53c4-a58c-d924cd3748a0 with identifier: MV28568
2026-03-28 11:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0151fb6-a780-53c4-a58c-d924cd3748a0 with scrape type 2
2026-03-28 11:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0151fb6-a780-53c4-a58c-d924cd3748a0 with scrape type 2
2026-03-28 11:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a0151fb6-a780-53c4-a58c-d924cd3748a0, identifier: MV28568
2026-03-28 11:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d1dadde-b25e-5539-ac33-ae3b015b70af with identifier: FC28046
2026-03-28 11:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d1dadde-b25e-5539-ac33-ae3b015b70af with identifier: FC28046
2026-03-28 11:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d1dadde-b25e-5539-ac33-ae3b015b70af with identifier: FC28046 to the API
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-28T16:25:30Z',
 'fuel_type': 'hybrid',
 'id': '6d1dadde-b25e-5539-ac33-ae3b015b70af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC28046',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 86029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-25',
 'seller_name': None,
 'title': 'Renault Captur 1.6 Hybrid E-Tech Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2022}
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-28 11:32:58 [auto1.be] INFO: Saving data for FC28046: {'auction_closing_time': 1774715130.0, 'created_time': 1773520260.666667, 'last_price_update_time': 1774697578.314519}
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC28046') HTTP/1.1" 204 0
2026-03-28 11:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b1e21240-1b44-58dd-835a-320d5a3a7f2b with identifier: PY40839
2026-03-28 11:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b1e21240-1b44-58dd-835a-320d5a3a7f2b with identifier: PY40839
2026-03-28 11:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b1e21240-1b44-58dd-835a-320d5a3a7f2b with identifier: PY40839 to the API
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:36Z',
 'fuel_type': 'petrol',
 'id': 'b1e21240-1b44-58dd-835a-320d5a3a7f2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY40839',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 160023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-21',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2022}
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY40839%27 HTTP/1.1" 200 None
2026-03-28 11:32:58 [auto1.be] INFO: Saving data for PY40839: {'auction_closing_time': 1774713636.0, 'created_time': 1773132099.50202, 'last_price_update_time': 1774697578.697978}
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY40839') HTTP/1.1" 204 0
2026-03-28 11:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a0151fb6-a780-53c4-a58c-d924cd3748a0 with identifier: MV28568
2026-03-28 11:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a0151fb6-a780-53c4-a58c-d924cd3748a0 with identifier: MV28568
2026-03-28 11:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a0151fb6-a780-53c4-a58c-d924cd3748a0 with identifier: MV28568 to the API
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:01:26Z',
 'fuel_type': 'diesel',
 'id': 'a0151fb6-a780-53c4-a58c-d924cd3748a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV28568',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 256854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-20',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-28 11:32:59 [auto1.be] INFO: Saving data for MV28568: {'auction_closing_time': 1774713686.0, 'created_time': 1773132175.677203, 'last_price_update_time': 1774697579.017019}
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MV28568') HTTP/1.1" 204 0
2026-03-28 11:32:59 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-28 11:32:59 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-28 11:32:59 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-28 11:32:59 [auto1.be] INFO: Scrape type for GL29646: 2
2026-03-28 11:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96ccd02e-4416-5222-beb2-efe77ba4ccab with identifier: GL29646
2026-03-28 11:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96ccd02e-4416-5222-beb2-efe77ba4ccab with scrape type 2
2026-03-28 11:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96ccd02e-4416-5222-beb2-efe77ba4ccab with scrape type 2
2026-03-28 11:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96ccd02e-4416-5222-beb2-efe77ba4ccab, identifier: GL29646
2026-03-28 11:32:59 [auto1.be] INFO: Found listing with ID: HL14568
2026-03-28 11:32:59 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-28 11:32:59 [auto1.be] INFO: Scrape type for AV28567: 2
2026-03-28 11:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with identifier: AV28567
2026-03-28 11:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with scrape type 2
2026-03-28 11:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with scrape type 2
2026-03-28 11:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f, identifier: AV28567
2026-03-28 11:32:59 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-28 11:32:59 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-28 11:32:59 [auto1.be] INFO: Scrape type for DT24627: 2
2026-03-28 11:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with identifier: DT24627
2026-03-28 11:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with scrape type 2
2026-03-28 11:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with scrape type 2
2026-03-28 11:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9847a40b-2ab2-5564-a7eb-235aebd8ab07, identifier: DT24627
2026-03-28 11:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96ccd02e-4416-5222-beb2-efe77ba4ccab with identifier: GL29646
2026-03-28 11:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96ccd02e-4416-5222-beb2-efe77ba4ccab with identifier: GL29646
2026-03-28 11:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96ccd02e-4416-5222-beb2-efe77ba4ccab with identifier: GL29646 to the API
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:53:40Z',
 'fuel_type': 'diesel',
 'id': '96ccd02e-4416-5222-beb2-efe77ba4ccab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL29646',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 123162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-25',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 111 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2011}
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-28 11:32:59 [auto1.be] INFO: Saving data for GL29646: {'auction_closing_time': 1774716820.0, 'created_time': 1773520431.735694, 'last_price_update_time': 1774697579.64881}
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GL29646') HTTP/1.1" 204 0
2026-03-28 11:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with identifier: AV28567
2026-03-28 11:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with identifier: AV28567
2026-03-28 11:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with identifier: AV28567 to the API
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:32:59Z',
 'fuel_type': 'petrol',
 'id': '2f4c3fea-c5da-5a46-a72e-587bf909bd4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV28567',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 191712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-02',
 'seller_name': None,
 'title': 'Citroen C4 1.6 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-28 11:32:59 [auto1.be] INFO: Saving data for AV28567: {'auction_closing_time': 1774715579.0, 'created_time': 1774611093.966959, 'last_price_update_time': 1774697579.935825}
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AV28567') HTTP/1.1" 204 0
2026-03-28 11:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with identifier: DT24627
2026-03-28 11:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with identifier: DT24627
2026-03-28 11:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with identifier: DT24627 to the API
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:23:05Z',
 'fuel_type': 'petrol',
 'id': '9847a40b-2ab2-5564-a7eb-235aebd8ab07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT24627',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 150442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-21',
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2017}
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-28 11:33:00 [auto1.be] INFO: Saving data for DT24627: {'auction_closing_time': 1774714985.0, 'created_time': 1773301634.253162, 'last_price_update_time': 1774697580.224045}
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DT24627') HTTP/1.1" 204 0
2026-03-28 11:33:00 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-28 11:33:00 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-28 11:33:00 [auto1.be] INFO: Scrape type for ZR23499: 2
2026-03-28 11:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with identifier: ZR23499
2026-03-28 11:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with scrape type 2
2026-03-28 11:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with scrape type 2
2026-03-28 11:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891, identifier: ZR23499
2026-03-28 11:33:00 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-28 11:33:00 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-28 11:33:00 [auto1.be] INFO: Scrape type for RL32581: 0
2026-03-28 11:33:00 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-28 11:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with identifier: ZR23499
2026-03-28 11:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with identifier: ZR23499
2026-03-28 11:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with identifier: ZR23499 to the API
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:18:22Z',
 'fuel_type': 'diesel',
 'id': '071b5eaa-f305-5ec8-a4d5-e838f8b5b891',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR23499',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 179022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-15',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-28 11:33:00 [auto1.be] INFO: Saving data for ZR23499: {'auction_closing_time': 1774714702.0, 'created_time': 1773520266.075254, 'last_price_update_time': 1774697580.612767}
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR23499') HTTP/1.1" 204 0
2026-03-28 11:33:00 [auto1.be] INFO: Found listing with ID: FJ69250
2026-03-28 11:33:00 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-28 11:33:00 [auto1.be] INFO: Scrape type for CG39340: 2
2026-03-28 11:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8901d4f9-1143-56f6-b88e-bef041ff79f1 with identifier: CG39340
2026-03-28 11:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8901d4f9-1143-56f6-b88e-bef041ff79f1 with scrape type 2
2026-03-28 11:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8901d4f9-1143-56f6-b88e-bef041ff79f1 with scrape type 2
2026-03-28 11:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8901d4f9-1143-56f6-b88e-bef041ff79f1, identifier: CG39340
2026-03-28 11:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8901d4f9-1143-56f6-b88e-bef041ff79f1 with identifier: CG39340
2026-03-28 11:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8901d4f9-1143-56f6-b88e-bef041ff79f1 with identifier: CG39340
2026-03-28 11:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8901d4f9-1143-56f6-b88e-bef041ff79f1 with identifier: CG39340 to the API
2026-03-28 11:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 118,
 'expiration_date': '2026-03-28T16:10:09Z',
 'fuel_type': 'petrol',
 'id': '8901d4f9-1143-56f6-b88e-bef041ff79f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG39340',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 51961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2016}
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-28 11:33:01 [auto1.be] INFO: Saving data for CG39340: {'auction_closing_time': 1774714209.0, 'created_time': 1774611124.513033, 'last_price_update_time': 1774697581.106768}
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CG39340') HTTP/1.1" 204 0
2026-03-28 11:33:01 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-28 11:33:01 [auto1.be] INFO: Scrape type for RU19747: 2
2026-03-28 11:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with identifier: RU19747
2026-03-28 11:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with scrape type 2
2026-03-28 11:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with scrape type 2
2026-03-28 11:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65, identifier: RU19747
2026-03-28 11:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with identifier: RU19747
2026-03-28 11:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with identifier: RU19747
2026-03-28 11:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with identifier: RU19747 to the API
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:30:04Z',
 'fuel_type': 'diesel',
 'id': '46ddd1a9-681c-5ace-8db4-b6c85f38cc65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU19747',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 169117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-17',
 'seller_name': None,
 'title': 'Jaguar XE 20d E-Performance Portfolio',
 'transmission': 'automatic',
 'trim': 'E-Performance Portfolio',
 'year': 2016}
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-28 11:33:01 [auto1.be] INFO: Saving data for RU19747: {'auction_closing_time': 1774715404.0, 'created_time': 1773747500.759796, 'last_price_update_time': 1774697581.493022}
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RU19747') HTTP/1.1" 204 0
2026-03-28 11:33:01 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-28 11:33:01 [auto1.be] INFO: Scrape type for ZR56949: 2
2026-03-28 11:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with identifier: ZR56949
2026-03-28 11:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with scrape type 2
2026-03-28 11:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with scrape type 2
2026-03-28 11:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430, identifier: ZR56949
2026-03-28 11:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with identifier: ZR56949
2026-03-28 11:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with identifier: ZR56949
2026-03-28 11:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with identifier: ZR56949 to the API
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:18:05Z',
 'fuel_type': 'diesel',
 'id': '0e3d8b2f-0b45-5bac-8370-2e8accb5a430',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR56949',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 157227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2021}
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-28 11:33:01 [auto1.be] INFO: Saving data for ZR56949: {'auction_closing_time': 1774714685.0, 'created_time': 1773132593.343894, 'last_price_update_time': 1774697581.858074}
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR56949') HTTP/1.1" 204 0
2026-03-28 11:33:01 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-28 11:33:01 [auto1.be] INFO: Scrape type for RP30975: 2
2026-03-28 11:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5618d539-8186-5418-95ae-d9583b7e2f7a with identifier: RP30975
2026-03-28 11:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5618d539-8186-5418-95ae-d9583b7e2f7a with scrape type 2
2026-03-28 11:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5618d539-8186-5418-95ae-d9583b7e2f7a with scrape type 2
2026-03-28 11:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5618d539-8186-5418-95ae-d9583b7e2f7a, identifier: RP30975
2026-03-28 11:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5618d539-8186-5418-95ae-d9583b7e2f7a with identifier: RP30975
2026-03-28 11:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5618d539-8186-5418-95ae-d9583b7e2f7a with identifier: RP30975
2026-03-28 11:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5618d539-8186-5418-95ae-d9583b7e2f7a with identifier: RP30975 to the API
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:58:55Z',
 'fuel_type': 'diesel',
 'id': '5618d539-8186-5418-95ae-d9583b7e2f7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP30975',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 180172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-08',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2016}
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-28 11:33:02 [auto1.be] INFO: Saving data for RP30975: {'auction_closing_time': 1774717135.0, 'created_time': 1773301773.417088, 'last_price_update_time': 1774697582.269545}
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RP30975') HTTP/1.1" 204 0
2026-03-28 11:33:02 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-28 11:33:02 [auto1.be] INFO: Scrape type for WB95668: 2
2026-03-28 11:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 908eec7f-7516-5981-917f-04dc3b597b5e with identifier: WB95668
2026-03-28 11:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 908eec7f-7516-5981-917f-04dc3b597b5e with scrape type 2
2026-03-28 11:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 908eec7f-7516-5981-917f-04dc3b597b5e with scrape type 2
2026-03-28 11:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 908eec7f-7516-5981-917f-04dc3b597b5e, identifier: WB95668
2026-03-28 11:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 908eec7f-7516-5981-917f-04dc3b597b5e with identifier: WB95668
2026-03-28 11:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 908eec7f-7516-5981-917f-04dc3b597b5e with identifier: WB95668
2026-03-28 11:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 908eec7f-7516-5981-917f-04dc3b597b5e with identifier: WB95668 to the API
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:57Z',
 'fuel_type': 'petrol',
 'id': '908eec7f-7516-5981-917f-04dc3b597b5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB95668',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 52050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-06',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Edition 30+ 2WD',
 'transmission': 'manual',
 'trim': 'Edition 30+ 2WD',
 'year': 2022}
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-28 11:33:02 [auto1.be] INFO: Saving data for WB95668: {'auction_closing_time': 1774715577.0, 'created_time': 1773834012.266552, 'last_price_update_time': 1774697582.656282}
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WB95668') HTTP/1.1" 204 0
2026-03-28 11:33:02 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-28 11:33:02 [auto1.be] INFO: Scrape type for RX75304: 2
2026-03-28 11:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fab1503-6f64-5957-9420-b7a7ebe4cffd with identifier: RX75304
2026-03-28 11:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fab1503-6f64-5957-9420-b7a7ebe4cffd with scrape type 2
2026-03-28 11:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fab1503-6f64-5957-9420-b7a7ebe4cffd with scrape type 2
2026-03-28 11:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7fab1503-6f64-5957-9420-b7a7ebe4cffd, identifier: RX75304
2026-03-28 11:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7fab1503-6f64-5957-9420-b7a7ebe4cffd with identifier: RX75304
2026-03-28 11:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7fab1503-6f64-5957-9420-b7a7ebe4cffd with identifier: RX75304
2026-03-28 11:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7fab1503-6f64-5957-9420-b7a7ebe4cffd with identifier: RX75304 to the API
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:33:11Z',
 'fuel_type': 'diesel',
 'id': '7fab1503-6f64-5957-9420-b7a7ebe4cffd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX75304',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 222184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-27',
 'seller_name': None,
 'title': 'Ford S-Max 1.8 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-28 11:33:03 [auto1.be] INFO: Saving data for RX75304: {'auction_closing_time': 1774715591.0, 'created_time': 1773132646.591593, 'last_price_update_time': 1774697583.040844}
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RX75304') HTTP/1.1" 204 0
2026-03-28 11:33:03 [auto1.be] INFO: Channel: 24h | Page: 43 | totalHits: 1816 | hits on page: 40
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: CB60498
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-28 11:33:03 [auto1.be] INFO: Scrape type for NP23299: 0
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: YU75052
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU75052%27 HTTP/1.1" 200 None
2026-03-28 11:33:03 [auto1.be] INFO: Scrape type for YU75052: 0
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-28 11:33:03 [auto1.be] INFO: Scrape type for KU11213: 2
2026-03-28 11:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with identifier: KU11213
2026-03-28 11:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with scrape type 2
2026-03-28 11:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with scrape type 2
2026-03-28 11:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7be753c5-0a2c-56d4-8600-92b70c76dbe3, identifier: KU11213
2026-03-28 11:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with identifier: KU11213
2026-03-28 11:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with identifier: KU11213
2026-03-28 11:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with identifier: KU11213 to the API
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:07:26Z',
 'fuel_type': 'diesel',
 'id': '7be753c5-0a2c-56d4-8600-92b70c76dbe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU11213',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 227835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-16',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2014}
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-28 11:33:03 [auto1.be] INFO: Saving data for KU11213: {'auction_closing_time': 1774714046.0, 'created_time': 1773693323.699756, 'last_price_update_time': 1774697583.532869}
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU11213') HTTP/1.1" 204 0
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-28 11:33:03 [auto1.be] INFO: Scrape type for FG88533: 2
2026-03-28 11:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f1f9139-c0d1-5232-a696-a508ce90d715 with identifier: FG88533
2026-03-28 11:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f1f9139-c0d1-5232-a696-a508ce90d715 with scrape type 2
2026-03-28 11:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f1f9139-c0d1-5232-a696-a508ce90d715 with scrape type 2
2026-03-28 11:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f1f9139-c0d1-5232-a696-a508ce90d715, identifier: FG88533
2026-03-28 11:33:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-28 11:33:03 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-28 11:33:03 [auto1.be] INFO: Scrape type for BP14655: 2
2026-03-28 11:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with identifier: BP14655
2026-03-28 11:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with scrape type 2
2026-03-28 11:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with scrape type 2
2026-03-28 11:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9, identifier: BP14655
2026-03-28 11:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f1f9139-c0d1-5232-a696-a508ce90d715 with identifier: FG88533
2026-03-28 11:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f1f9139-c0d1-5232-a696-a508ce90d715 with identifier: FG88533
2026-03-28 11:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f1f9139-c0d1-5232-a696-a508ce90d715 with identifier: FG88533 to the API
2026-03-28 11:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:25:26Z',
 'fuel_type': 'diesel',
 'id': '8f1f9139-c0d1-5232-a696-a508ce90d715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG88533',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60 Cross Country',
 'odometer': 184985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-06',
 'seller_name': None,
 'title': 'Volvo V60 Cross Country 2.0 D3 Pro',
 'transmission': 'automatic',
 'trim': 'Pro',
 'year': 2017}
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-28 11:33:04 [auto1.be] INFO: Saving data for FG88533: {'auction_closing_time': 1774715126.0, 'created_time': 1773135910.865129, 'last_price_update_time': 1774697584.139596}
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FG88533') HTTP/1.1" 204 0
2026-03-28 11:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with identifier: BP14655
2026-03-28 11:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with identifier: BP14655
2026-03-28 11:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with identifier: BP14655 to the API
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-28T16:48:05Z',
 'fuel_type': 'petrol',
 'id': '2111ab50-e1c7-5a65-9c0e-62a3443fc0e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP14655',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 82255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-28',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Mild-Hybrid GLE',
 'transmission': 'manual',
 'trim': 'GLE',
 'year': 2020}
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-28 11:33:04 [auto1.be] INFO: Saving data for BP14655: {'auction_closing_time': 1774716485.0, 'created_time': 1773866608.10521, 'last_price_update_time': 1774697584.420676}
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BP14655') HTTP/1.1" 204 0
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-28 11:33:04 [auto1.be] INFO: Scrape type for XE73160: 2
2026-03-28 11:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with identifier: XE73160
2026-03-28 11:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with scrape type 2
2026-03-28 11:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with scrape type 2
2026-03-28 11:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc, identifier: XE73160
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-28 11:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with identifier: XE73160
2026-03-28 11:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with identifier: XE73160
2026-03-28 11:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with identifier: XE73160 to the API
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:39:19Z',
 'fuel_type': 'diesel',
 'id': '6eefabaa-9783-5e72-8cc3-9dc4062c79fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE73160',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 184151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-22',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2011}
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-28 11:33:04 [auto1.be] INFO: Saving data for XE73160: {'auction_closing_time': 1774715959.0, 'created_time': 1773693900.046291, 'last_price_update_time': 1774697584.816306}
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XE73160') HTTP/1.1" 204 0
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-28 11:33:04 [auto1.be] INFO: Scrape type for PC96861: 0
2026-03-28 11:33:04 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-28 11:33:04 [auto1.be] INFO: Scrape type for AE23838: 2
2026-03-28 11:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with identifier: AE23838
2026-03-28 11:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with scrape type 2
2026-03-28 11:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with scrape type 2
2026-03-28 11:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7, identifier: AE23838
2026-03-28 11:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with identifier: AE23838
2026-03-28 11:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with identifier: AE23838
2026-03-28 11:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with identifier: AE23838 to the API
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:18:58Z',
 'fuel_type': 'petrol',
 'id': 'fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE23838',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 168072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-14',
 'seller_name': None,
 'title': 'Mazda 2 1.5 Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2019}
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-28 11:33:05 [auto1.be] INFO: Saving data for AE23838: {'auction_closing_time': 1774714738.0, 'created_time': 1773233800.359867, 'last_price_update_time': 1774697585.331713}
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AE23838') HTTP/1.1" 204 0
2026-03-28 11:33:05 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-28 11:33:05 [auto1.be] INFO: Scrape type for HP14917: 0
2026-03-28 11:33:05 [auto1.be] INFO: Found listing with ID: ZD51863
2026-03-28 11:33:05 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-28 11:33:05 [auto1.be] INFO: Scrape type for HB19534: 2
2026-03-28 11:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb7c6609-2f10-5d13-9ef1-ff7bac632954 with identifier: HB19534
2026-03-28 11:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb7c6609-2f10-5d13-9ef1-ff7bac632954 with scrape type 2
2026-03-28 11:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb7c6609-2f10-5d13-9ef1-ff7bac632954 with scrape type 2
2026-03-28 11:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb7c6609-2f10-5d13-9ef1-ff7bac632954, identifier: HB19534
2026-03-28 11:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb7c6609-2f10-5d13-9ef1-ff7bac632954 with identifier: HB19534
2026-03-28 11:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb7c6609-2f10-5d13-9ef1-ff7bac632954 with identifier: HB19534
2026-03-28 11:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb7c6609-2f10-5d13-9ef1-ff7bac632954 with identifier: HB19534 to the API
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:47:25Z',
 'fuel_type': 'diesel',
 'id': 'cb7c6609-2f10-5d13-9ef1-ff7bac632954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB19534',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 161681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-26',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2017}
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-28 11:33:05 [auto1.be] INFO: Saving data for HB19534: {'auction_closing_time': 1774716445.0, 'created_time': 1773301720.088691, 'last_price_update_time': 1774697585.734008}
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HB19534') HTTP/1.1" 204 0
2026-03-28 11:33:05 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-28 11:33:05 [auto1.be] INFO: Scrape type for ND89972: 2
2026-03-28 11:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with identifier: ND89972
2026-03-28 11:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with scrape type 2
2026-03-28 11:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with scrape type 2
2026-03-28 11:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1, identifier: ND89972
2026-03-28 11:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with identifier: ND89972
2026-03-28 11:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with identifier: ND89972
2026-03-28 11:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with identifier: ND89972 to the API
2026-03-28 11:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:54:49Z',
 'fuel_type': 'petrol',
 'id': '85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND89972',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 14358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-05',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 35 AMG Shooting Brake Mild-Hybrid '
          '4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2023}
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-28 11:33:06 [auto1.be] INFO: Saving data for ND89972: {'auction_closing_time': 1774716889.0, 'created_time': 1773132509.81165, 'last_price_update_time': 1774697586.119538}
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ND89972') HTTP/1.1" 204 0
2026-03-28 11:33:06 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-28 11:33:06 [auto1.be] INFO: Scrape type for CB86664: 2
2026-03-28 11:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab8f4039-3298-571a-9f56-fb3bf3761e99 with identifier: CB86664
2026-03-28 11:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab8f4039-3298-571a-9f56-fb3bf3761e99 with scrape type 2
2026-03-28 11:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab8f4039-3298-571a-9f56-fb3bf3761e99 with scrape type 2
2026-03-28 11:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ab8f4039-3298-571a-9f56-fb3bf3761e99, identifier: CB86664
2026-03-28 11:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ab8f4039-3298-571a-9f56-fb3bf3761e99 with identifier: CB86664
2026-03-28 11:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ab8f4039-3298-571a-9f56-fb3bf3761e99 with identifier: CB86664
2026-03-28 11:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ab8f4039-3298-571a-9f56-fb3bf3761e99 with identifier: CB86664 to the API
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:38:32Z',
 'fuel_type': 'petrol',
 'id': 'ab8f4039-3298-571a-9f56-fb3bf3761e99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB86664',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 103072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Ultimate',
 'transmission': 'manual',
 'trim': 'Ultimate',
 'year': 2022}
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-28 11:33:06 [auto1.be] INFO: Saving data for CB86664: {'auction_closing_time': 1774715912.0, 'created_time': 1773866591.722398, 'last_price_update_time': 1774697586.498206}
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB86664') HTTP/1.1" 204 0
2026-03-28 11:33:06 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-28 11:33:06 [auto1.be] INFO: Scrape type for HL95749: 2
2026-03-28 11:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with identifier: HL95749
2026-03-28 11:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with scrape type 2
2026-03-28 11:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with scrape type 2
2026-03-28 11:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ce52f5ce-1b5d-58ca-9610-cea76740a1b5, identifier: HL95749
2026-03-28 11:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with identifier: HL95749
2026-03-28 11:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with identifier: HL95749
2026-03-28 11:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with identifier: HL95749 to the API
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:20:12Z',
 'fuel_type': 'diesel',
 'id': 'ce52f5ce-1b5d-58ca-9610-cea76740a1b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL95749',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 93933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-04',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 HDi 330 L1H2 Komfort HDi 130',
 'transmission': 'manual',
 'trim': '330 L1H2 Komfort HDi 130',
 'year': 2015}
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-28 11:33:06 [auto1.be] INFO: Saving data for HL95749: {'auction_closing_time': 1774714812.0, 'created_time': 1774265466.227732, 'last_price_update_time': 1774697586.886286}
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HL95749') HTTP/1.1" 204 0
2026-03-28 11:33:06 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-28 11:33:06 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-28 11:33:06 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-28 11:33:06 [auto1.be] INFO: Scrape type for CA72484: 0
2026-03-28 11:33:06 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-28 11:33:06 [auto1.be] INFO: Scrape type for LG37246: 2
2026-03-28 11:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with identifier: LG37246
2026-03-28 11:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with scrape type 2
2026-03-28 11:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with scrape type 2
2026-03-28 11:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df, identifier: LG37246
2026-03-28 11:33:07 [scrapy.extensions.logstats] INFO: Crawled 135 pages (at 16 pages/min), scraped 182 items (at 102 items/min)
2026-03-28 11:33:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-28 11:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with identifier: LG37246
2026-03-28 11:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with identifier: LG37246
2026-03-28 11:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with identifier: LG37246 to the API
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:54:44Z',
 'fuel_type': 'diesel',
 'id': '9a889c8a-1f00-5397-a9ff-f61e47b2d1df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG37246',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 98367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2012}
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-28 11:33:07 [auto1.be] INFO: Saving data for LG37246: {'auction_closing_time': 1774716884.0, 'created_time': 1773747312.111392, 'last_price_update_time': 1774697587.296084}
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LG37246') HTTP/1.1" 204 0
2026-03-28 11:33:07 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-28 11:33:07 [auto1.be] INFO: Scrape type for PF95077: 2
2026-03-28 11:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b2988d4-1154-5132-92c8-31545762130b with identifier: PF95077
2026-03-28 11:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b2988d4-1154-5132-92c8-31545762130b with scrape type 2
2026-03-28 11:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b2988d4-1154-5132-92c8-31545762130b with scrape type 2
2026-03-28 11:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3b2988d4-1154-5132-92c8-31545762130b, identifier: PF95077
2026-03-28 11:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3b2988d4-1154-5132-92c8-31545762130b with identifier: PF95077
2026-03-28 11:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3b2988d4-1154-5132-92c8-31545762130b with identifier: PF95077
2026-03-28 11:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3b2988d4-1154-5132-92c8-31545762130b with identifier: PF95077 to the API
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:26:06Z',
 'fuel_type': 'diesel',
 'id': '3b2988d4-1154-5132-92c8-31545762130b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF95077',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 202592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-24',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-28 11:33:07 [auto1.be] INFO: Saving data for PF95077: {'auction_closing_time': 1774715166.0, 'created_time': 1773237022.44888, 'last_price_update_time': 1774697587.860595}
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PF95077') HTTP/1.1" 204 0
2026-03-28 11:33:07 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-28 11:33:07 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-28 11:33:07 [auto1.be] INFO: Scrape type for NC25574: 2
2026-03-28 11:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 224e1efe-488b-523a-a490-064d09792db1 with identifier: NC25574
2026-03-28 11:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 224e1efe-488b-523a-a490-064d09792db1 with scrape type 2
2026-03-28 11:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 224e1efe-488b-523a-a490-064d09792db1 with scrape type 2
2026-03-28 11:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 224e1efe-488b-523a-a490-064d09792db1, identifier: NC25574
2026-03-28 11:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 224e1efe-488b-523a-a490-064d09792db1 with identifier: NC25574
2026-03-28 11:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 224e1efe-488b-523a-a490-064d09792db1 with identifier: NC25574
2026-03-28 11:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 224e1efe-488b-523a-a490-064d09792db1 with identifier: NC25574 to the API
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-28T16:51:40Z',
 'fuel_type': 'diesel',
 'id': '224e1efe-488b-523a-a490-064d09792db1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC25574',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 108325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Raptor',
 'year': 2021}
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-28 11:33:08 [auto1.be] INFO: Saving data for NC25574: {'auction_closing_time': 1774716700.0, 'created_time': 1773131939.556374, 'last_price_update_time': 1774697588.431198}
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC25574') HTTP/1.1" 204 0
2026-03-28 11:33:08 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-28 11:33:08 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-28 11:33:08 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-28 11:33:08 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-28 11:33:08 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-28 11:33:08 [auto1.be] INFO: Scrape type for GP69185: 2
2026-03-28 11:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with identifier: GP69185
2026-03-28 11:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with scrape type 2
2026-03-28 11:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with scrape type 2
2026-03-28 11:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb183f3c-d53b-51e0-9c08-f157fd80d1c9, identifier: GP69185
2026-03-28 11:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with identifier: GP69185
2026-03-28 11:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with identifier: GP69185
2026-03-28 11:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with identifier: GP69185 to the API
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:18:37Z',
 'fuel_type': 'diesel',
 'id': 'bb183f3c-d53b-51e0-9c08-f157fd80d1c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP69185',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 46569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi Mild-Hybrid 350 L4 Trend',
 'transmission': 'manual',
 'trim': '350 L4 Trend',
 'year': 2023}
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-28 11:33:08 [auto1.be] INFO: Saving data for GP69185: {'auction_closing_time': 1774714717.0, 'created_time': 1773520255.384527, 'last_price_update_time': 1774697588.871668}
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GP69185') HTTP/1.1" 204 0
2026-03-28 11:33:08 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-28 11:33:08 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-28 11:33:08 [auto1.be] INFO: Scrape type for WP69561: 2
2026-03-28 11:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aaa1b77-9d44-59bd-9453-925cb5511883 with identifier: WP69561
2026-03-28 11:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aaa1b77-9d44-59bd-9453-925cb5511883 with scrape type 2
2026-03-28 11:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6aaa1b77-9d44-59bd-9453-925cb5511883 with scrape type 2
2026-03-28 11:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6aaa1b77-9d44-59bd-9453-925cb5511883, identifier: WP69561
2026-03-28 11:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6aaa1b77-9d44-59bd-9453-925cb5511883 with identifier: WP69561
2026-03-28 11:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6aaa1b77-9d44-59bd-9453-925cb5511883 with identifier: WP69561
2026-03-28 11:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6aaa1b77-9d44-59bd-9453-925cb5511883 with identifier: WP69561 to the API
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:07:16Z',
 'fuel_type': 'petrol',
 'id': '6aaa1b77-9d44-59bd-9453-925cb5511883',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP69561',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 193036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-25',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2014}
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-28 11:33:09 [auto1.be] INFO: Saving data for WP69561: {'auction_closing_time': 1774714036.0, 'created_time': 1773833774.500726, 'last_price_update_time': 1774697589.264706}
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP69561') HTTP/1.1" 204 0
2026-03-28 11:33:09 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-28 11:33:09 [auto1.be] INFO: Scrape type for YX48939: 2
2026-03-28 11:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dcbd62c-38df-5370-94cc-79408beef08a with identifier: YX48939
2026-03-28 11:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dcbd62c-38df-5370-94cc-79408beef08a with scrape type 2
2026-03-28 11:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dcbd62c-38df-5370-94cc-79408beef08a with scrape type 2
2026-03-28 11:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3dcbd62c-38df-5370-94cc-79408beef08a, identifier: YX48939
2026-03-28 11:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3dcbd62c-38df-5370-94cc-79408beef08a with identifier: YX48939
2026-03-28 11:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3dcbd62c-38df-5370-94cc-79408beef08a with identifier: YX48939
2026-03-28 11:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3dcbd62c-38df-5370-94cc-79408beef08a with identifier: YX48939 to the API
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:27:31Z',
 'fuel_type': 'hybrid',
 'id': '3dcbd62c-38df-5370-94cc-79408beef08a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX48939',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 36261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-20',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-28 11:33:09 [auto1.be] INFO: Saving data for YX48939: {'auction_closing_time': 1774715251.0, 'created_time': 1774611130.548507, 'last_price_update_time': 1774697589.696}
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YX48939') HTTP/1.1" 204 0
2026-03-28 11:33:09 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-28 11:33:09 [auto1.be] INFO: Scrape type for TH19224: 2
2026-03-28 11:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f668b3b-4f59-5cf7-8358-d016400cd4ce with identifier: TH19224
2026-03-28 11:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f668b3b-4f59-5cf7-8358-d016400cd4ce with scrape type 2
2026-03-28 11:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f668b3b-4f59-5cf7-8358-d016400cd4ce with scrape type 2
2026-03-28 11:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f668b3b-4f59-5cf7-8358-d016400cd4ce, identifier: TH19224
2026-03-28 11:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f668b3b-4f59-5cf7-8358-d016400cd4ce with identifier: TH19224
2026-03-28 11:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f668b3b-4f59-5cf7-8358-d016400cd4ce with identifier: TH19224
2026-03-28 11:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f668b3b-4f59-5cf7-8358-d016400cd4ce with identifier: TH19224 to the API
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:39:27Z',
 'fuel_type': 'petrol',
 'id': '8f668b3b-4f59-5cf7-8358-d016400cd4ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH19224',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 65179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-08',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2015}
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-28 11:33:10 [auto1.be] INFO: Saving data for TH19224: {'auction_closing_time': 1774715967.0, 'created_time': 1773833924.784205, 'last_price_update_time': 1774697590.183086}
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH19224') HTTP/1.1" 204 0
2026-03-28 11:33:10 [auto1.be] INFO: Channel: 24h | Page: 44 | totalHits: 1816 | hits on page: 40
2026-03-28 11:33:10 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-28 11:33:10 [auto1.be] INFO: Scrape type for XM93272: 2
2026-03-28 11:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4357a86-d4f6-5e8e-969e-664e196b38d6 with identifier: XM93272
2026-03-28 11:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4357a86-d4f6-5e8e-969e-664e196b38d6 with scrape type 2
2026-03-28 11:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4357a86-d4f6-5e8e-969e-664e196b38d6 with scrape type 2
2026-03-28 11:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4357a86-d4f6-5e8e-969e-664e196b38d6, identifier: XM93272
2026-03-28 11:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4357a86-d4f6-5e8e-969e-664e196b38d6 with identifier: XM93272
2026-03-28 11:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4357a86-d4f6-5e8e-969e-664e196b38d6 with identifier: XM93272
2026-03-28 11:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4357a86-d4f6-5e8e-969e-664e196b38d6 with identifier: XM93272 to the API
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:45:27Z',
 'fuel_type': 'diesel',
 'id': 'f4357a86-d4f6-5e8e-969e-664e196b38d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM93272',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 120936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-06',
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2017}
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-28 11:33:10 [auto1.be] INFO: Saving data for XM93272: {'auction_closing_time': 1774716327.0, 'created_time': 1774611125.689432, 'last_price_update_time': 1774697590.571269}
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XM93272') HTTP/1.1" 204 0
2026-03-28 11:33:10 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-28 11:33:10 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-28 11:33:10 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-28 11:33:10 [auto1.be] INFO: Scrape type for NM63028: 2
2026-03-28 11:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with identifier: NM63028
2026-03-28 11:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with scrape type 2
2026-03-28 11:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with scrape type 2
2026-03-28 11:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1, identifier: NM63028
2026-03-28 11:33:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:33:10 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-28 11:33:10 [auto1.be] INFO: Scrape type for XJ47711: 2
2026-03-28 11:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19227997-8039-5f82-8183-48fcfde7f983 with identifier: XJ47711
2026-03-28 11:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19227997-8039-5f82-8183-48fcfde7f983 with scrape type 2
2026-03-28 11:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19227997-8039-5f82-8183-48fcfde7f983 with scrape type 2
2026-03-28 11:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 19227997-8039-5f82-8183-48fcfde7f983, identifier: XJ47711
2026-03-28 11:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with identifier: NM63028
2026-03-28 11:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with identifier: NM63028
2026-03-28 11:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with identifier: NM63028 to the API
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:13:07Z',
 'fuel_type': 'petrol',
 'id': '7e12bef2-c3f5-5cd9-ab84-9081692f87e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM63028',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 129173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-17',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 L1 Komfort Plus',
 'transmission': 'manual',
 'trim': 'L1 Komfort Plus',
 'year': 2016}
2026-03-28 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-28 11:33:11 [auto1.be] INFO: Saving data for NM63028: {'auction_closing_time': 1774714387.0, 'created_time': 1774611126.817051, 'last_price_update_time': 1774697591.085832}
2026-03-28 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NM63028') HTTP/1.1" 204 0
2026-03-28 11:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 19227997-8039-5f82-8183-48fcfde7f983 with identifier: XJ47711
2026-03-28 11:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 19227997-8039-5f82-8183-48fcfde7f983 with identifier: XJ47711
2026-03-28 11:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 19227997-8039-5f82-8183-48fcfde7f983 with identifier: XJ47711 to the API
2026-03-28 11:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:46:52Z',
 'fuel_type': 'hybrid',
 'id': '19227997-8039-5f82-8183-48fcfde7f983',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ47711',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 63370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 Plug-in Hybrid ë-EAT8 Shine Pack',
 'transmission': 'automatic',
 'trim': 'Shine Pack',
 'year': 2021}
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-28 11:33:12 [auto1.be] INFO: Saving data for XJ47711: {'auction_closing_time': 1774716412.0, 'created_time': 1773693588.366722, 'last_price_update_time': 1774697592.158718}
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ47711') HTTP/1.1" 204 0
2026-03-28 11:33:12 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-28 11:33:12 [auto1.be] INFO: Scrape type for EP14144: 2
2026-03-28 11:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01c72808-1ba6-5994-b029-1ddddb40490b with identifier: EP14144
2026-03-28 11:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01c72808-1ba6-5994-b029-1ddddb40490b with scrape type 2
2026-03-28 11:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01c72808-1ba6-5994-b029-1ddddb40490b with scrape type 2
2026-03-28 11:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 01c72808-1ba6-5994-b029-1ddddb40490b, identifier: EP14144
2026-03-28 11:33:12 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-28 11:33:12 [auto1.be] INFO: Scrape type for DB63111: 2
2026-03-28 11:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2aedc04-bdda-5b21-989c-f90552752a3d with identifier: DB63111
2026-03-28 11:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2aedc04-bdda-5b21-989c-f90552752a3d with scrape type 2
2026-03-28 11:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2aedc04-bdda-5b21-989c-f90552752a3d with scrape type 2
2026-03-28 11:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a2aedc04-bdda-5b21-989c-f90552752a3d, identifier: DB63111
2026-03-28 11:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 01c72808-1ba6-5994-b029-1ddddb40490b with identifier: EP14144
2026-03-28 11:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 01c72808-1ba6-5994-b029-1ddddb40490b with identifier: EP14144
2026-03-28 11:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 01c72808-1ba6-5994-b029-1ddddb40490b with identifier: EP14144 to the API
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:36:13Z',
 'fuel_type': 'petrol',
 'id': '01c72808-1ba6-5994-b029-1ddddb40490b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP14144',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 119383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-17',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-28 11:33:12 [auto1.be] INFO: Saving data for EP14144: {'auction_closing_time': 1774715773.0, 'created_time': 1774265454.642219, 'last_price_update_time': 1774697592.664195}
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP14144') HTTP/1.1" 204 0
2026-03-28 11:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a2aedc04-bdda-5b21-989c-f90552752a3d with identifier: DB63111
2026-03-28 11:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a2aedc04-bdda-5b21-989c-f90552752a3d with identifier: DB63111
2026-03-28 11:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a2aedc04-bdda-5b21-989c-f90552752a3d with identifier: DB63111 to the API
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:41:00Z',
 'fuel_type': 'petrol',
 'id': 'a2aedc04-bdda-5b21-989c-f90552752a3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB63111',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 212010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-19',
 'seller_name': None,
 'title': 'Kia Rio 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2012}
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-28 11:33:12 [auto1.be] INFO: Saving data for DB63111: {'auction_closing_time': 1774716060.0, 'created_time': 1773866464.842481, 'last_price_update_time': 1774697592.957566}
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB63111') HTTP/1.1" 204 0
2026-03-28 11:33:12 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-28 11:33:12 [auto1.be] INFO: Scrape type for SA79242: 2
2026-03-28 11:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with identifier: SA79242
2026-03-28 11:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with scrape type 2
2026-03-28 11:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with scrape type 2
2026-03-28 11:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620, identifier: SA79242
2026-03-28 11:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with identifier: SA79242
2026-03-28 11:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with identifier: SA79242
2026-03-28 11:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with identifier: SA79242 to the API
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:20:08Z',
 'fuel_type': 'petrol',
 'id': 'bbe2ea34-26d2-58c8-b5f3-766ff7ec7620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA79242',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 197674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-29',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turbo Quadrifoglio Verde',
 'transmission': 'manual',
 'trim': 'Quadrifoglio Verde',
 'year': 2011}
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-28 11:33:13 [auto1.be] INFO: Saving data for SA79242: {'auction_closing_time': 1774714808.0, 'created_time': 1773237244.209865, 'last_price_update_time': 1774697593.350326}
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SA79242') HTTP/1.1" 204 0
2026-03-28 11:33:13 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-28 11:33:13 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-28 11:33:13 [auto1.be] INFO: Scrape type for RR03336: 2
2026-03-28 11:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fa70c8d-d199-54f0-9df1-1d5f6845390c with identifier: RR03336
2026-03-28 11:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fa70c8d-d199-54f0-9df1-1d5f6845390c with scrape type 2
2026-03-28 11:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fa70c8d-d199-54f0-9df1-1d5f6845390c with scrape type 2
2026-03-28 11:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2fa70c8d-d199-54f0-9df1-1d5f6845390c, identifier: RR03336
2026-03-28 11:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2fa70c8d-d199-54f0-9df1-1d5f6845390c with identifier: RR03336
2026-03-28 11:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2fa70c8d-d199-54f0-9df1-1d5f6845390c with identifier: RR03336
2026-03-28 11:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2fa70c8d-d199-54f0-9df1-1d5f6845390c with identifier: RR03336 to the API
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:26:32Z',
 'fuel_type': 'diesel',
 'id': '2fa70c8d-d199-54f0-9df1-1d5f6845390c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR03336',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Liana',
 'odometer': 111306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-18',
 'seller_name': None,
 'title': 'Suzuki Liana 1.4 DDiS',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-28 11:33:13 [auto1.be] INFO: Saving data for RR03336: {'auction_closing_time': 1774715192.0, 'created_time': 1773132095.254832, 'last_price_update_time': 1774697593.758854}
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR03336') HTTP/1.1" 204 0
2026-03-28 11:33:13 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-28 11:33:13 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-28 11:33:13 [auto1.be] INFO: Scrape type for SJ78748: 2
2026-03-28 11:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with identifier: SJ78748
2026-03-28 11:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with scrape type 2
2026-03-28 11:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with scrape type 2
2026-03-28 11:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a, identifier: SJ78748
2026-03-28 11:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with identifier: SJ78748
2026-03-28 11:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with identifier: SJ78748
2026-03-28 11:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with identifier: SJ78748 to the API
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:42:27Z',
 'fuel_type': 'diesel',
 'id': '7560812a-7c8c-5f8f-83a6-3ba82ffaae2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ78748',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 189244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-21',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-28 11:33:14 [auto1.be] INFO: Saving data for SJ78748: {'auction_closing_time': 1774716147.0, 'created_time': 1773747449.61006, 'last_price_update_time': 1774697594.238772}
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ78748') HTTP/1.1" 204 0
2026-03-28 11:33:14 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-28 11:33:14 [auto1.be] INFO: Scrape type for ZN76480: 2
2026-03-28 11:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 034d32e7-ca29-5991-8ed9-2bb27008c1ff with identifier: ZN76480
2026-03-28 11:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 034d32e7-ca29-5991-8ed9-2bb27008c1ff with scrape type 2
2026-03-28 11:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 034d32e7-ca29-5991-8ed9-2bb27008c1ff with scrape type 2
2026-03-28 11:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 034d32e7-ca29-5991-8ed9-2bb27008c1ff, identifier: ZN76480
2026-03-28 11:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 034d32e7-ca29-5991-8ed9-2bb27008c1ff with identifier: ZN76480
2026-03-28 11:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 034d32e7-ca29-5991-8ed9-2bb27008c1ff with identifier: ZN76480
2026-03-28 11:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 034d32e7-ca29-5991-8ed9-2bb27008c1ff with identifier: ZN76480 to the API
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-28T16:02:27Z',
 'fuel_type': 'diesel',
 'id': '034d32e7-ca29-5991-8ed9-2bb27008c1ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN76480',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 144963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Limited',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Limited',
 'year': 2022}
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-28 11:33:14 [auto1.be] INFO: Saving data for ZN76480: {'auction_closing_time': 1774713747.0, 'created_time': 1774611127.957654, 'last_price_update_time': 1774697594.617829}
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN76480') HTTP/1.1" 204 0
2026-03-28 11:33:14 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-28 11:33:14 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-28 11:33:14 [auto1.be] INFO: Scrape type for BD10300: 2
2026-03-28 11:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3212e001-69af-5cee-80ea-05b81d630228 with identifier: BD10300
2026-03-28 11:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3212e001-69af-5cee-80ea-05b81d630228 with scrape type 2
2026-03-28 11:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3212e001-69af-5cee-80ea-05b81d630228 with scrape type 2
2026-03-28 11:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3212e001-69af-5cee-80ea-05b81d630228, identifier: BD10300
2026-03-28 11:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3212e001-69af-5cee-80ea-05b81d630228 with identifier: BD10300
2026-03-28 11:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3212e001-69af-5cee-80ea-05b81d630228 with identifier: BD10300
2026-03-28 11:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3212e001-69af-5cee-80ea-05b81d630228 with identifier: BD10300 to the API
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-28T16:57:37Z',
 'fuel_type': 'hybrid',
 'id': '3212e001-69af-5cee-80ea-05b81d630228',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD10300',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 92502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T4 Recharge Plug-in Hybrid Essential 2WD',
 'transmission': 'automatic',
 'trim': 'Essential 2WD',
 'year': 2021}
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-28 11:33:15 [auto1.be] INFO: Saving data for BD10300: {'auction_closing_time': 1774717057.0, 'created_time': 1774265429.947401, 'last_price_update_time': 1774697595.031895}
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BD10300') HTTP/1.1" 204 0
2026-03-28 11:33:15 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-28 11:33:15 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-28 11:33:15 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-28 11:33:15 [auto1.be] INFO: Scrape type for XE15288: 2
2026-03-28 11:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with identifier: XE15288
2026-03-28 11:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with scrape type 2
2026-03-28 11:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with scrape type 2
2026-03-28 11:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f4381f0-d177-54d8-b3af-360b8f13e6f7, identifier: XE15288
2026-03-28 11:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with identifier: XE15288
2026-03-28 11:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with identifier: XE15288
2026-03-28 11:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with identifier: XE15288 to the API
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:27:48Z',
 'fuel_type': 'diesel',
 'id': '1f4381f0-d177-54d8-b3af-360b8f13e6f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE15288',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 345528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-09',
 'seller_name': None,
 'title': 'BMW 5er 530d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-28 11:33:15 [auto1.be] INFO: Saving data for XE15288: {'auction_closing_time': 1774715268.0, 'created_time': 1774384386.313011, 'last_price_update_time': 1774697595.422807}
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XE15288') HTTP/1.1" 204 0
2026-03-28 11:33:15 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-28 11:33:15 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-28 11:33:15 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-28 11:33:15 [auto1.be] INFO: Scrape type for AX51995: 2
2026-03-28 11:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with identifier: AX51995
2026-03-28 11:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with scrape type 2
2026-03-28 11:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with scrape type 2
2026-03-28 11:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 39a73c7c-2447-5e92-aab5-6f3ccf58a987, identifier: AX51995
2026-03-28 11:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with identifier: AX51995
2026-03-28 11:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with identifier: AX51995
2026-03-28 11:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with identifier: AX51995 to the API
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:28:27Z',
 'fuel_type': 'diesel',
 'id': '39a73c7c-2447-5e92-aab5-6f3ccf58a987',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX51995',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 115843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2019}
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-28 11:33:15 [auto1.be] INFO: Saving data for AX51995: {'auction_closing_time': 1774715307.0, 'created_time': 1773520258.113219, 'last_price_update_time': 1774697595.805152}
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX51995') HTTP/1.1" 204 0
2026-03-28 11:33:15 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-28 11:33:15 [auto1.be] INFO: Scrape type for SR34780: 2
2026-03-28 11:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4722792-8b55-5cbb-9e50-4647aeecf256 with identifier: SR34780
2026-03-28 11:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4722792-8b55-5cbb-9e50-4647aeecf256 with scrape type 2
2026-03-28 11:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4722792-8b55-5cbb-9e50-4647aeecf256 with scrape type 2
2026-03-28 11:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4722792-8b55-5cbb-9e50-4647aeecf256, identifier: SR34780
2026-03-28 11:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4722792-8b55-5cbb-9e50-4647aeecf256 with identifier: SR34780
2026-03-28 11:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4722792-8b55-5cbb-9e50-4647aeecf256 with identifier: SR34780
2026-03-28 11:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4722792-8b55-5cbb-9e50-4647aeecf256 with identifier: SR34780 to the API
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:25:07Z',
 'fuel_type': 'diesel',
 'id': 'f4722792-8b55-5cbb-9e50-4647aeecf256',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR34780',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 58061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-19',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Rapid Maxi Extra',
 'transmission': 'manual',
 'trim': 'Rapid Maxi Extra',
 'year': 2020}
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-28 11:33:16 [auto1.be] INFO: Saving data for SR34780: {'auction_closing_time': 1774715107.0, 'created_time': 1774254709.273744, 'last_price_update_time': 1774697596.30663}
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR34780') HTTP/1.1" 204 0
2026-03-28 11:33:16 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-28 11:33:16 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-28 11:33:16 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-28 11:33:16 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-28 11:33:16 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-28 11:33:16 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-28 11:33:16 [auto1.be] INFO: Scrape type for WK50026: 0
2026-03-28 11:33:16 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-28 11:33:16 [auto1.be] INFO: Scrape type for CP91123: 2
2026-03-28 11:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9137b048-af85-56fa-b073-cf9877a6c6b6 with identifier: CP91123
2026-03-28 11:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9137b048-af85-56fa-b073-cf9877a6c6b6 with scrape type 2
2026-03-28 11:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9137b048-af85-56fa-b073-cf9877a6c6b6 with scrape type 2
2026-03-28 11:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9137b048-af85-56fa-b073-cf9877a6c6b6, identifier: CP91123
2026-03-28 11:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9137b048-af85-56fa-b073-cf9877a6c6b6 with identifier: CP91123
2026-03-28 11:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9137b048-af85-56fa-b073-cf9877a6c6b6 with identifier: CP91123
2026-03-28 11:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9137b048-af85-56fa-b073-cf9877a6c6b6 with identifier: CP91123 to the API
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:22:08Z',
 'fuel_type': 'petrol',
 'id': '9137b048-af85-56fa-b073-cf9877a6c6b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP91123',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 190051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-19',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-28 11:33:16 [auto1.be] INFO: Saving data for CP91123: {'auction_closing_time': 1774714928.0, 'created_time': 1774297998.769522, 'last_price_update_time': 1774697596.730589}
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP91123') HTTP/1.1" 204 0
2026-03-28 11:33:16 [auto1.be] INFO: Channel: 24h | Page: 45 | totalHits: 1816 | hits on page: 40
2026-03-28 11:33:16 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-28 11:33:16 [auto1.be] INFO: Scrape type for ZR84759: 2
2026-03-28 11:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with identifier: ZR84759
2026-03-28 11:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with scrape type 2
2026-03-28 11:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with scrape type 2
2026-03-28 11:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 06168cd0-ba08-5fa9-92ab-50b6e7211c24, identifier: ZR84759
2026-03-28 11:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with identifier: ZR84759
2026-03-28 11:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with identifier: ZR84759
2026-03-28 11:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with identifier: ZR84759 to the API
2026-03-28 11:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:15:45Z',
 'fuel_type': 'petrol',
 'id': '06168cd0-ba08-5fa9-92ab-50b6e7211c24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR84759',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 140203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-15',
 'seller_name': None,
 'title': 'Chevrolet Cruze 1.8 LTZ',
 'transmission': 'manual',
 'trim': 'LTZ',
 'year': 2011}
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-28 11:33:17 [auto1.be] INFO: Saving data for ZR84759: {'auction_closing_time': 1774714545.0, 'created_time': 1773225539.157312, 'last_price_update_time': 1774697597.129042}
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR84759') HTTP/1.1" 204 0
2026-03-28 11:33:17 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-28 11:33:17 [auto1.be] INFO: Scrape type for JS18374: 2
2026-03-28 11:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b538691-ff5a-59fd-bbdf-8e023a42c42e with identifier: JS18374
2026-03-28 11:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e with scrape type 2
2026-03-28 11:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e with scrape type 2
2026-03-28 11:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0b538691-ff5a-59fd-bbdf-8e023a42c42e, identifier: JS18374
2026-03-28 11:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:33:17 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-28 11:33:17 [auto1.be] INFO: Scrape type for GD11285: 2
2026-03-28 11:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db12d969-99b5-5e66-afb2-b0420ae80955 with identifier: GD11285
2026-03-28 11:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db12d969-99b5-5e66-afb2-b0420ae80955 with scrape type 2
2026-03-28 11:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db12d969-99b5-5e66-afb2-b0420ae80955 with scrape type 2
2026-03-28 11:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db12d969-99b5-5e66-afb2-b0420ae80955, identifier: GD11285
2026-03-28 11:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0b538691-ff5a-59fd-bbdf-8e023a42c42e with identifier: JS18374
2026-03-28 11:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0b538691-ff5a-59fd-bbdf-8e023a42c42e with identifier: JS18374
2026-03-28 11:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0b538691-ff5a-59fd-bbdf-8e023a42c42e with identifier: JS18374 to the API
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-28T16:59:26Z',
 'fuel_type': 'petrol',
 'id': '0b538691-ff5a-59fd-bbdf-8e023a42c42e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS18374',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 71806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-02-17',
 'seller_name': None,
 'title': 'Nissan Micra 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 1999}
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-28 11:33:17 [auto1.be] INFO: Saving data for JS18374: {'auction_closing_time': 1774717166.0, 'created_time': 1774611135.66766, 'last_price_update_time': 1774697597.621055}
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS18374') HTTP/1.1" 204 0
2026-03-28 11:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db12d969-99b5-5e66-afb2-b0420ae80955 with identifier: GD11285
2026-03-28 11:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db12d969-99b5-5e66-afb2-b0420ae80955 with identifier: GD11285
2026-03-28 11:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db12d969-99b5-5e66-afb2-b0420ae80955 with identifier: GD11285 to the API
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:50:36Z',
 'fuel_type': 'petrol',
 'id': 'db12d969-99b5-5e66-afb2-b0420ae80955',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD11285',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 79717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-04',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.2 TCe Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2015}
2026-03-28 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-28 11:33:18 [auto1.be] INFO: Saving data for GD11285: {'auction_closing_time': 1774716636.0, 'created_time': 1773133000.887376, 'last_price_update_time': 1774697598.010033}
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GD11285') HTTP/1.1" 204 0
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-28 11:33:18 [auto1.be] INFO: Scrape type for VF88831: 2
2026-03-28 11:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with identifier: VF88831
2026-03-28 11:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with scrape type 2
2026-03-28 11:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with scrape type 2
2026-03-28 11:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da, identifier: VF88831
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-28 11:33:18 [auto1.be] INFO: Scrape type for SA37733: 2
2026-03-28 11:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3f4080-cb18-5257-80df-25178c1a6d1a with identifier: SA37733
2026-03-28 11:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3f4080-cb18-5257-80df-25178c1a6d1a with scrape type 2
2026-03-28 11:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3f4080-cb18-5257-80df-25178c1a6d1a with scrape type 2
2026-03-28 11:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f3f4080-cb18-5257-80df-25178c1a6d1a, identifier: SA37733
2026-03-28 11:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with identifier: VF88831
2026-03-28 11:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with identifier: VF88831
2026-03-28 11:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with identifier: VF88831 to the API
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:32:39Z',
 'fuel_type': 'hybrid',
 'id': 'd1ae2a17-7b8d-51d1-8f5a-f01d30af17da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF88831',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'CT-Serie',
 'odometer': 93038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-30',
 'seller_name': None,
 'title': 'Lexus CT-Serie CT 200h Executive Line',
 'transmission': 'automatic',
 'trim': 'Executive Line',
 'year': 2013}
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-28 11:33:18 [auto1.be] INFO: Saving data for VF88831: {'auction_closing_time': 1774715559.0, 'created_time': 1774611133.935131, 'last_price_update_time': 1774697598.519512}
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VF88831') HTTP/1.1" 204 0
2026-03-28 11:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f3f4080-cb18-5257-80df-25178c1a6d1a with identifier: SA37733
2026-03-28 11:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f3f4080-cb18-5257-80df-25178c1a6d1a with identifier: SA37733
2026-03-28 11:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f3f4080-cb18-5257-80df-25178c1a6d1a with identifier: SA37733 to the API
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:25Z',
 'fuel_type': 'diesel',
 'id': '9f3f4080-cb18-5257-80df-25178c1a6d1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA37733',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 179836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-14',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2017}
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-28 11:33:18 [auto1.be] INFO: Saving data for SA37733: {'auction_closing_time': 1774714165.0, 'created_time': 1774265445.574342, 'last_price_update_time': 1774697598.798507}
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SA37733') HTTP/1.1" 204 0
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-28 11:33:18 [auto1.be] INFO: Scrape type for BC49055: 0
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-28 11:33:18 [auto1.be] INFO: Scrape type for TF03002: 0
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-28 11:33:18 [auto1.be] INFO: Scrape type for TZ99758: 0
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-28 11:33:18 [auto1.be] INFO: Scrape type for WW99205: 0
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: FV40639
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-28 11:33:18 [auto1.be] INFO: Scrape type for UX15937: 0
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-28 11:33:18 [auto1.be] INFO: Scrape type for MJ08102: 0
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: JU84298
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-28 11:33:18 [auto1.be] INFO: Scrape type for JZ88652: 0
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-28 11:33:18 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-28 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for JX00156: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for EW63431: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: BC23353
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: WC70774
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC70774%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for WC70774: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for XK61886: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for FN69818: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: RL41837
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL41837%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for RL41837: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for VZ63754: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: DB52098
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB52098%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for DB52098: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for PR84870: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: NM84983
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84983%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for NM84983: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: TD45447
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD45447%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for TD45447: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: MB97201
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB97201%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for MB97201: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: JF18972
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for FA61625: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for XU03064: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: GN38450
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN38450%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for GN38450: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: YA37935
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: PL26855
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL26855%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for PL26855: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for MR51068: 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for WK14396: 2
2026-03-28 11:33:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with identifier: WK14396
2026-03-28 11:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with scrape type 2
2026-03-28 11:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with scrape type 2
2026-03-28 11:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8, identifier: WK14396
2026-03-28 11:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with identifier: WK14396
2026-03-28 11:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with identifier: WK14396
2026-03-28 11:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with identifier: WK14396 to the API
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:16:17Z',
 'fuel_type': 'petrol',
 'id': 'bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK14396',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 153623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-27',
 'seller_name': None,
 'title': 'Volvo C30 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Saving data for WK14396: {'auction_closing_time': 1774714577.0, 'created_time': 1774298097.842679, 'last_price_update_time': 1774697599.682184}
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WK14396') HTTP/1.1" 204 0
2026-03-28 11:33:19 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-28 11:33:19 [auto1.be] INFO: Scrape type for DY28234: 2
2026-03-28 11:33:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with identifier: DY28234
2026-03-28 11:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with scrape type 2
2026-03-28 11:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with scrape type 2
2026-03-28 11:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134, identifier: DY28234
2026-03-28 11:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with identifier: DY28234
2026-03-28 11:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with identifier: DY28234
2026-03-28 11:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with identifier: DY28234 to the API
2026-03-28 11:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:07:41Z',
 'fuel_type': 'diesel',
 'id': '51e13d09-bd7d-51b2-b761-5a5a3ed5a134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY28234',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 175226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-28 11:33:20 [auto1.be] INFO: Saving data for DY28234: {'auction_closing_time': 1774714061.0, 'created_time': 1773834165.871049, 'last_price_update_time': 1774697600.146802}
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY28234') HTTP/1.1" 204 0
2026-03-28 11:33:20 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-28 11:33:20 [auto1.be] INFO: Scrape type for ED70069: 2
2026-03-28 11:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with identifier: ED70069
2026-03-28 11:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with scrape type 2
2026-03-28 11:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with scrape type 2
2026-03-28 11:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43, identifier: ED70069
2026-03-28 11:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with identifier: ED70069
2026-03-28 11:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with identifier: ED70069
2026-03-28 11:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with identifier: ED70069 to the API
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:28:00Z',
 'fuel_type': 'diesel',
 'id': 'ff0f0b1a-bba0-5416-b990-3a04b2bc2a43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED70069',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 89813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-28 11:33:20 [auto1.be] INFO: Saving data for ED70069: {'auction_closing_time': 1774715280.0, 'created_time': 1774297847.773704, 'last_price_update_time': 1774697600.536275}
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ED70069') HTTP/1.1" 204 0
2026-03-28 11:33:20 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-28 11:33:20 [auto1.be] INFO: Scrape type for ST89131: 2
2026-03-28 11:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with identifier: ST89131
2026-03-28 11:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with scrape type 2
2026-03-28 11:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with scrape type 2
2026-03-28 11:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a, identifier: ST89131
2026-03-28 11:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with identifier: ST89131
2026-03-28 11:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with identifier: ST89131
2026-03-28 11:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with identifier: ST89131 to the API
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:43:32Z',
 'fuel_type': 'diesel',
 'id': 'd1dea36b-77b5-5b3e-81d5-a5d50db97f6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST89131',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 184032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-15',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi 4x2',
 'transmission': 'manual',
 'trim': '4x2',
 'year': 2013}
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-28 11:33:20 [auto1.be] INFO: Saving data for ST89131: {'auction_closing_time': 1774716212.0, 'created_time': 1773224956.501311, 'last_price_update_time': 1774697600.930295}
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ST89131') HTTP/1.1" 204 0
2026-03-28 11:33:20 [auto1.be] INFO: Found listing with ID: VV01116
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV01116%27 HTTP/1.1" 200 None
2026-03-28 11:33:20 [auto1.be] INFO: Scrape type for VV01116: 2
2026-03-28 11:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34f02ea9-4cf8-593f-a2fa-5de1c6810d28 with identifier: VV01116
2026-03-28 11:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f02ea9-4cf8-593f-a2fa-5de1c6810d28 with scrape type 2
2026-03-28 11:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34f02ea9-4cf8-593f-a2fa-5de1c6810d28 with scrape type 2
2026-03-28 11:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 34f02ea9-4cf8-593f-a2fa-5de1c6810d28, identifier: VV01116
2026-03-28 11:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 34f02ea9-4cf8-593f-a2fa-5de1c6810d28 with identifier: VV01116
2026-03-28 11:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 34f02ea9-4cf8-593f-a2fa-5de1c6810d28 with identifier: VV01116
2026-03-28 11:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 34f02ea9-4cf8-593f-a2fa-5de1c6810d28 with identifier: VV01116 to the API
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:02:27Z',
 'fuel_type': 'diesel',
 'id': '34f02ea9-4cf8-593f-a2fa-5de1c6810d28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV01116',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 126618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-28',
 'seller_name': None,
 'title': 'BMW 5er 520d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV01116%27 HTTP/1.1" 200 None
2026-03-28 11:33:21 [auto1.be] INFO: Saving data for VV01116: {'auction_closing_time': 1774713747.0, 'created_time': 1773133403.364797, 'last_price_update_time': 1774697601.297441}
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VV01116') HTTP/1.1" 204 0
2026-03-28 11:33:21 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-28 11:33:21 [auto1.be] INFO: Scrape type for FJ79675: 2
2026-03-28 11:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 200cd7dd-45c7-51ab-846b-27b49601aaf7 with identifier: FJ79675
2026-03-28 11:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200cd7dd-45c7-51ab-846b-27b49601aaf7 with scrape type 2
2026-03-28 11:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 200cd7dd-45c7-51ab-846b-27b49601aaf7 with scrape type 2
2026-03-28 11:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 200cd7dd-45c7-51ab-846b-27b49601aaf7, identifier: FJ79675
2026-03-28 11:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 200cd7dd-45c7-51ab-846b-27b49601aaf7 with identifier: FJ79675
2026-03-28 11:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 200cd7dd-45c7-51ab-846b-27b49601aaf7 with identifier: FJ79675
2026-03-28 11:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 200cd7dd-45c7-51ab-846b-27b49601aaf7 with identifier: FJ79675 to the API
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:10:18Z',
 'fuel_type': 'petrol',
 'id': '200cd7dd-45c7-51ab-846b-27b49601aaf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ79675',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 115817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': None,
 'title': 'Renault Twingo 0.9 Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-28 11:33:21 [auto1.be] INFO: Saving data for FJ79675: {'auction_closing_time': 1774714218.0, 'created_time': 1774611131.264244, 'last_price_update_time': 1774697601.68361}
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ79675') HTTP/1.1" 204 0
2026-03-28 11:33:21 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-28 11:33:21 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-28 11:33:21 [auto1.be] INFO: Scrape type for WC98842: 2
2026-03-28 11:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with identifier: WC98842
2026-03-28 11:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with scrape type 2
2026-03-28 11:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with scrape type 2
2026-03-28 11:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 66750d3f-3e98-520f-bcd4-52bf5c7783d7, identifier: WC98842
2026-03-28 11:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with identifier: WC98842
2026-03-28 11:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with identifier: WC98842
2026-03-28 11:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with identifier: WC98842 to the API
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:15:37Z',
 'fuel_type': 'petrol',
 'id': '66750d3f-3e98-520f-bcd4-52bf5c7783d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC98842',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 118075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-20',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2017}
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-28 11:33:22 [auto1.be] INFO: Saving data for WC98842: {'auction_closing_time': 1774714537.0, 'created_time': 1774611132.2031, 'last_price_update_time': 1774697602.337421}
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC98842') HTTP/1.1" 204 0
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: NY53837
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-28 11:33:22 [auto1.be] INFO: Scrape type for FH97290: 2
2026-03-28 11:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da5127d3-9044-5174-b42b-c727e0da4b7c with identifier: FH97290
2026-03-28 11:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da5127d3-9044-5174-b42b-c727e0da4b7c with scrape type 2
2026-03-28 11:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da5127d3-9044-5174-b42b-c727e0da4b7c with scrape type 2
2026-03-28 11:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: da5127d3-9044-5174-b42b-c727e0da4b7c, identifier: FH97290
2026-03-28 11:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: da5127d3-9044-5174-b42b-c727e0da4b7c with identifier: FH97290
2026-03-28 11:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: da5127d3-9044-5174-b42b-c727e0da4b7c with identifier: FH97290
2026-03-28 11:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: da5127d3-9044-5174-b42b-c727e0da4b7c with identifier: FH97290 to the API
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:33:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:06:40Z',
 'fuel_type': 'petrol',
 'id': 'da5127d3-9044-5174-b42b-c727e0da4b7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH97290',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 59826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-28',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-28 11:33:22 [auto1.be] INFO: Saving data for FH97290: {'auction_closing_time': 1774714000.0, 'created_time': 1774611133.147032, 'last_price_update_time': 1774697602.716946}
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FH97290') HTTP/1.1" 204 0
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-28 11:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:33:22 [auto1.be] INFO: Channel: 24h | Page: 46 | totalHits: 1817 | hits on page: 17
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-28 11:33:22 [auto1.be] INFO: Scrape type for MR51068: 0
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: BP74088
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP74088%27 HTTP/1.1" 200 None
2026-03-28 11:33:22 [auto1.be] INFO: Scrape type for BP74088: 0
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: JJ45584
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-28 11:33:22 [auto1.be] INFO: Scrape type for RA11008: 0
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-28 11:33:22 [auto1.be] INFO: Scrape type for XT87195: 0
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-28 11:33:22 [auto1.be] INFO: Scrape type for UT35373: 0
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-28 11:33:22 [auto1.be] INFO: Scrape type for XZ54371: 0
2026-03-28 11:33:22 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-28 11:33:22 [auto1.be] INFO: Scrape type for AU32211: 0
2026-03-28 11:33:23 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-28 11:33:23 [auto1.be] INFO: Found listing with ID: JE06286
2026-03-28 11:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE06286%27 HTTP/1.1" 200 None
2026-03-28 11:33:23 [auto1.be] INFO: Scrape type for JE06286: 0
2026-03-28 11:33:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:33:23 [auto1.be] INFO: Channel: 24h | Page: 47 | totalHits: 1817 | hits on page: 0
2026-03-28 11:33:23 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 11:33:23 [auto1.be] INFO: auto1.be Batch config: batch 1/2
2026-03-28 11:33:23 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 7, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 8, <ScrapeType.BATCH_SKIPPED: 5>: 12}
2026-03-28 11:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20last_price_update_time%20lt%201774265603 HTTP/1.1" 200 None
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AH20594') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AP83103') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AP91249') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BM68423') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BR63185') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BU18930') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CR77406') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DF78773') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DP40243') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DX48205') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DY72469') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EC91781') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EH56421') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EK47235') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EU26838') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EW42874') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EY25535') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FG10633') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FP23489') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GJ29340') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GK55021') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HA10598') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JA94811') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JB20319') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JF89630') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JM82997') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JU60924') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KH36682') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KR18974') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KT25789') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KX29220') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LC17110') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LZ64398') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MA85279') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MF09823') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MN73654') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MS70199') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NR39490') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NS39608') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NV75936') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ74768') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PC12097') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PW43378') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PZ32679') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SH91747') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ05954') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SS91421') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SW21472') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TM16327') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TN47955') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TS39251') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TW96430') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TY37950') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UD01999') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UG34139') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UJ56192') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UP32209') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UP47591') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UR33188') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UT97718') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VD15269') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VM37625') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VR80201') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VT97415') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WZ70386') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XC92324') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YT37209') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YW96446') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZA29789') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC38359') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZD36527') HTTP/1.1" 204 0
2026-03-28 11:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF17816') HTTP/1.1" 204 0
2026-03-28 11:33:24 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (216 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_25_2026-03-28T11_30_00.jl
2026-03-28 11:33:24 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 786811,
 'downloader/request_count': 451,
 'downloader/request_method_count/GET': 402,
 'downloader/request_method_count/POST': 49,
 'downloader/response_bytes': 227934325,
 'downloader/response_count': 451,
 'downloader/response_status_count/200': 451,
 'dupefilter/filtered': 14,
 'elapsed_time_seconds': 197.790566,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 11, 33, 24, 737667, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 216,
 'log_count/DEBUG': 6233,
 'log_count/INFO': 6963,
 'memusage/max': 202149888,
 'memusage/startup': 149688320,
 'photo_download_count': 312,
 'request_depth_max': 50,
 'response_received_count': 139,
 'scheduler/dequeued': 451,
 'scheduler/dequeued/memory': 451,
 'scheduler/enqueued': 451,
 'scheduler/enqueued/memory': 451,
 'scrape_type/batch_skipped': 917,
 'scrape_type/new': 44,
 'scrape_type/price_update': 172,
 'scrape_type/skipped': 710,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 139,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.3972598509394016,
 'scrapy-zyte-api/mean_response_seconds': 2.4418358773080184,
 'scrapy-zyte-api/processed': 139,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 139,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 138,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 139,
 'scrapy-zyte-api/request_args/httpRequestBody': 49,
 'scrapy-zyte-api/request_args/httpRequestMethod': 49,
 'scrapy-zyte-api/request_args/httpResponseBody': 139,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 139,
 'scrapy-zyte-api/request_args/sessionContext': 139,
 'scrapy-zyte-api/request_args/url': 139,
 'scrapy-zyte-api/status_codes/200': 139,
 'scrapy-zyte-api/success': 139,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1857,
 'source/total_available': 1817,
 'start_time': datetime.datetime(2026, 3, 28, 11, 30, 6, 947101, tzinfo=datetime.timezone.utc)}
2026-03-28 11:33:24 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 11:33:24 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f8aa6ee8fd0>
2026-03-28 11:33:24 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f8aa6d6ffd0>