2026-03-30 08:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 08:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 08:30:06 [auto1.be] INFO: Batch mode enabled: batch 1/2
2026-03-30 08:30:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-30 08:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 08:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 08:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 08:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 08:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 6eb987c5c3304aa5
2026-03-30 08:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 08:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_25_2026-03-30T08_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 08:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 08:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 08:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 08:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 08:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 08:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 08:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 08:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2106
2026-03-30 08:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 08:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 08:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 08:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 08:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 08:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 08:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 08:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-30 08:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 08:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 08:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 08:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 08:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 08:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 08:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 08:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 08:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 08:30:22 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1492 | hits on page: 40
2026-03-30 08:30:22 [auto1.be] INFO: Found listing with ID: HL85042
2026-03-30 08:30:22 [auto1.be] INFO: Found listing with ID: WR16749
2026-03-30 08:30:22 [auto1.be] INFO: Found listing with ID: DJ32328
2026-03-30 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ32328%27 HTTP/1.1" 200 None
2026-03-30 08:30:22 [auto1.be] INFO: Scrape type for DJ32328: 1
2026-03-30 08:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:22 [auto1.be] INFO: Found listing with ID: NS39608
2026-03-30 08:30:22 [auto1.be] INFO: Found listing with ID: FE21102
2026-03-30 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE21102%27 HTTP/1.1" 200 None
2026-03-30 08:30:22 [auto1.be] INFO: Scrape type for FE21102: 2
2026-03-30 08:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e5ed648-c9ef-5301-9a86-16c02344435f with identifier: FE21102
2026-03-30 08:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e5ed648-c9ef-5301-9a86-16c02344435f with scrape type 2
2026-03-30 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e5ed648-c9ef-5301-9a86-16c02344435f with scrape type 2
2026-03-30 08:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3e5ed648-c9ef-5301-9a86-16c02344435f, identifier: FE21102
2026-03-30 08:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3e5ed648-c9ef-5301-9a86-16c02344435f with identifier: FE21102
2026-03-30 08:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:30:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 08:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:30:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 08:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3e5ed648-c9ef-5301-9a86-16c02344435f with identifier: FE21102
2026-03-30 08:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3e5ed648-c9ef-5301-9a86-16c02344435f with identifier: FE21102 to the API
2026-03-30 08:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:09:57Z',
 'fuel_type': 'diesel',
 'id': '3e5ed648-c9ef-5301-9a86-16c02344435f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE21102',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 138597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-15',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Cosmo Pack',
 'transmission': 'manual',
 'trim': 'Cosmo Pack',
 'year': 2013}
2026-03-30 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE21102%27 HTTP/1.1" 200 None
2026-03-30 08:30:23 [auto1.be] INFO: Saving data for FE21102: {'auction_closing_time': 1774969797.0, 'created_time': 1774265502.212169, 'last_price_update_time': 1774859423.883534}
2026-03-30 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FE21102') HTTP/1.1" 204 0
2026-03-30 08:30:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:23 [auto1.be] INFO: Found listing with ID: JM82997
2026-03-30 08:30:23 [auto1.be] INFO: Found listing with ID: KP84190
2026-03-30 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP84190%27 HTTP/1.1" 200 None
2026-03-30 08:30:23 [auto1.be] INFO: Scrape type for KP84190: 2
2026-03-30 08:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2891bcba-bdbf-5c0d-a814-9aa15d39ed28 with identifier: KP84190
2026-03-30 08:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2891bcba-bdbf-5c0d-a814-9aa15d39ed28 with scrape type 2
2026-03-30 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2891bcba-bdbf-5c0d-a814-9aa15d39ed28 with scrape type 2
2026-03-30 08:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2891bcba-bdbf-5c0d-a814-9aa15d39ed28, identifier: KP84190
2026-03-30 08:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2891bcba-bdbf-5c0d-a814-9aa15d39ed28 with identifier: KP84190
2026-03-30 08:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:30:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 08:30:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2891bcba-bdbf-5c0d-a814-9aa15d39ed28 with identifier: KP84190
2026-03-30 08:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2891bcba-bdbf-5c0d-a814-9aa15d39ed28 with identifier: KP84190 to the API
2026-03-30 08:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:48:14Z',
 'fuel_type': 'diesel',
 'id': '2891bcba-bdbf-5c0d-a814-9aa15d39ed28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP84190',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 26492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-19',
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H2',
 'transmission': 'manual',
 'trim': '33 L2H2',
 'year': 2015}
2026-03-30 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP84190%27 HTTP/1.1" 200 None
2026-03-30 08:30:26 [auto1.be] INFO: Saving data for KP84190: {'auction_closing_time': 1774972094.0, 'created_time': 1774125165.908502, 'last_price_update_time': 1774859426.497964}
2026-03-30 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP84190') HTTP/1.1" 204 0
2026-03-30 08:30:26 [auto1.be] INFO: Found listing with ID: EH30324
2026-03-30 08:30:26 [auto1.be] INFO: Found listing with ID: ME19194
2026-03-30 08:30:26 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-30 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW36552%27 HTTP/1.1" 200 None
2026-03-30 08:30:26 [auto1.be] INFO: Scrape type for CW36552: 2
2026-03-30 08:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a751ce71-7173-5c65-a126-aba3c2e73e8e with identifier: CW36552
2026-03-30 08:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a751ce71-7173-5c65-a126-aba3c2e73e8e with scrape type 2
2026-03-30 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a751ce71-7173-5c65-a126-aba3c2e73e8e with scrape type 2
2026-03-30 08:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a751ce71-7173-5c65-a126-aba3c2e73e8e, identifier: CW36552
2026-03-30 08:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a751ce71-7173-5c65-a126-aba3c2e73e8e with identifier: CW36552
2026-03-30 08:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:30:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 08:30:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:30:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 08:30:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a751ce71-7173-5c65-a126-aba3c2e73e8e with identifier: CW36552
2026-03-30 08:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a751ce71-7173-5c65-a126-aba3c2e73e8e with identifier: CW36552 to the API
2026-03-30 08:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:53:17Z',
 'fuel_type': 'petrol',
 'id': 'a751ce71-7173-5c65-a126-aba3c2e73e8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW36552',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 199212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-15',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW36552%27 HTTP/1.1" 200 None
2026-03-30 08:30:27 [auto1.be] INFO: Saving data for CW36552: {'auction_closing_time': 1774972397.0, 'created_time': 1773136580.244709, 'last_price_update_time': 1774859427.998012}
2026-03-30 08:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CW36552') HTTP/1.1" 204 0
2026-03-30 08:30:28 [auto1.be] INFO: Found listing with ID: XM81929
2026-03-30 08:30:28 [auto1.be] INFO: Found listing with ID: RL35333
2026-03-30 08:30:28 [auto1.be] INFO: Found listing with ID: WD23717
2026-03-30 08:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD23717%27 HTTP/1.1" 200 None
2026-03-30 08:30:28 [auto1.be] INFO: Scrape type for WD23717: 2
2026-03-30 08:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2bea57a-c424-5b47-a596-84f66a97f716 with identifier: WD23717
2026-03-30 08:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2bea57a-c424-5b47-a596-84f66a97f716 with scrape type 2
2026-03-30 08:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2bea57a-c424-5b47-a596-84f66a97f716 with scrape type 2
2026-03-30 08:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c2bea57a-c424-5b47-a596-84f66a97f716, identifier: WD23717
2026-03-30 08:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c2bea57a-c424-5b47-a596-84f66a97f716 with identifier: WD23717
2026-03-30 08:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c2bea57a-c424-5b47-a596-84f66a97f716 with identifier: WD23717
2026-03-30 08:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c2bea57a-c424-5b47-a596-84f66a97f716 with identifier: WD23717 to the API
2026-03-30 08:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:45:48Z',
 'fuel_type': 'diesel',
 'id': 'c2bea57a-c424-5b47-a596-84f66a97f716',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD23717',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 34614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-22',
 'seller_name': None,
 'title': 'Land Rover Evoque D165 R-Dynamic',
 'transmission': 'manual',
 'trim': 'R-Dynamic',
 'year': 2022}
2026-03-30 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD23717%27 HTTP/1.1" 200 None
2026-03-30 08:30:29 [auto1.be] INFO: Saving data for WD23717: {'auction_closing_time': 1774971948.0, 'created_time': 1773661557.566305, 'last_price_update_time': 1774859429.908508}
2026-03-30 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WD23717') HTTP/1.1" 204 0
2026-03-30 08:30:30 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH74025%27 HTTP/1.1" 200 None
2026-03-30 08:30:30 [auto1.be] INFO: Scrape type for XH74025: 2
2026-03-30 08:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: effe9606-d1af-5b69-be8f-e5a4ba67b8ad with identifier: XH74025
2026-03-30 08:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item effe9606-d1af-5b69-be8f-e5a4ba67b8ad with scrape type 2
2026-03-30 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item effe9606-d1af-5b69-be8f-e5a4ba67b8ad with scrape type 2
2026-03-30 08:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: effe9606-d1af-5b69-be8f-e5a4ba67b8ad, identifier: XH74025
2026-03-30 08:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: effe9606-d1af-5b69-be8f-e5a4ba67b8ad with identifier: XH74025
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 08:30:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: effe9606-d1af-5b69-be8f-e5a4ba67b8ad with identifier: XH74025
2026-03-30 08:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: effe9606-d1af-5b69-be8f-e5a4ba67b8ad with identifier: XH74025 to the API
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:17:46Z',
 'fuel_type': 'petrol',
 'id': 'effe9606-d1af-5b69-be8f-e5a4ba67b8ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH74025',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 78767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-23',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH74025%27 HTTP/1.1" 200 None
2026-03-30 08:30:30 [auto1.be] INFO: Saving data for XH74025: {'auction_closing_time': 1774970266.0, 'created_time': 1773134481.58507, 'last_price_update_time': 1774859430.577743}
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XH74025') HTTP/1.1" 204 0
2026-03-30 08:30:30 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-30 08:30:30 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-30 08:30:30 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ68089%27 HTTP/1.1" 200 None
2026-03-30 08:30:30 [auto1.be] INFO: Scrape type for HJ68089: 2
2026-03-30 08:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26b2fefb-512c-5ecb-81eb-4134a7a5035f with identifier: HJ68089
2026-03-30 08:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b2fefb-512c-5ecb-81eb-4134a7a5035f with scrape type 2
2026-03-30 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26b2fefb-512c-5ecb-81eb-4134a7a5035f with scrape type 2
2026-03-30 08:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 26b2fefb-512c-5ecb-81eb-4134a7a5035f, identifier: HJ68089
2026-03-30 08:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 26b2fefb-512c-5ecb-81eb-4134a7a5035f with identifier: HJ68089
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 08:30:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 26b2fefb-512c-5ecb-81eb-4134a7a5035f with identifier: HJ68089
2026-03-30 08:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 26b2fefb-512c-5ecb-81eb-4134a7a5035f with identifier: HJ68089 to the API
2026-03-30 08:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:41:34Z',
 'fuel_type': 'diesel',
 'id': '26b2fefb-512c-5ecb-81eb-4134a7a5035f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ68089',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 197143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-12',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ68089%27 HTTP/1.1" 200 None
2026-03-30 08:30:31 [auto1.be] INFO: Saving data for HJ68089: {'auction_closing_time': 1774971694.0, 'created_time': 1773132521.536557, 'last_price_update_time': 1774859431.568706}
2026-03-30 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ68089') HTTP/1.1" 204 0
2026-03-30 08:30:31 [auto1.be] INFO: Found listing with ID: VP17023
2026-03-30 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP17023%27 HTTP/1.1" 200 None
2026-03-30 08:30:31 [auto1.be] INFO: Scrape type for VP17023: 1
2026-03-30 08:30:31 [auto1.be] INFO: Found listing with ID: CF49225
2026-03-30 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF49225%27 HTTP/1.1" 200 None
2026-03-30 08:30:31 [auto1.be] INFO: Scrape type for CF49225: 1
2026-03-30 08:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:31 [auto1.be] INFO: Found listing with ID: ST59109
2026-03-30 08:30:31 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-30 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF11904%27 HTTP/1.1" 200 None
2026-03-30 08:30:31 [auto1.be] INFO: Scrape type for XF11904: 2
2026-03-30 08:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7417e7b-4d5c-56ce-a513-52c101391bf7 with identifier: XF11904
2026-03-30 08:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7417e7b-4d5c-56ce-a513-52c101391bf7 with scrape type 2
2026-03-30 08:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7417e7b-4d5c-56ce-a513-52c101391bf7 with scrape type 2
2026-03-30 08:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f7417e7b-4d5c-56ce-a513-52c101391bf7, identifier: XF11904
2026-03-30 08:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f7417e7b-4d5c-56ce-a513-52c101391bf7 with identifier: XF11904
2026-03-30 08:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f7417e7b-4d5c-56ce-a513-52c101391bf7 with identifier: XF11904
2026-03-30 08:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f7417e7b-4d5c-56ce-a513-52c101391bf7 with identifier: XF11904 to the API
2026-03-30 08:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:14:27Z',
 'fuel_type': 'diesel',
 'id': 'f7417e7b-4d5c-56ce-a513-52c101391bf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF11904',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 93950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-30',
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2020}
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF11904%27 HTTP/1.1" 200 None
2026-03-30 08:30:32 [auto1.be] INFO: Saving data for XF11904: {'auction_closing_time': 1774970067.0, 'created_time': 1773348282.285996, 'last_price_update_time': 1774859432.088535}
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XF11904') HTTP/1.1" 204 0
2026-03-30 08:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:32 [auto1.be] INFO: Found listing with ID: HA15365
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA15365%27 HTTP/1.1" 200 None
2026-03-30 08:30:32 [auto1.be] INFO: Scrape type for HA15365: 1
2026-03-30 08:30:32 [auto1.be] INFO: Found listing with ID: NN50309
2026-03-30 08:30:32 [auto1.be] INFO: Found listing with ID: RD52510
2026-03-30 08:30:32 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-30 08:30:32 [auto1.be] INFO: Found listing with ID: AV31741
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV31741%27 HTTP/1.1" 200 None
2026-03-30 08:30:32 [auto1.be] INFO: Scrape type for AV31741: 2
2026-03-30 08:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1d5113-4d22-579e-a8be-fd6ce0183b55 with identifier: AV31741
2026-03-30 08:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1d5113-4d22-579e-a8be-fd6ce0183b55 with scrape type 2
2026-03-30 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc1d5113-4d22-579e-a8be-fd6ce0183b55 with scrape type 2
2026-03-30 08:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc1d5113-4d22-579e-a8be-fd6ce0183b55, identifier: AV31741
2026-03-30 08:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc1d5113-4d22-579e-a8be-fd6ce0183b55 with identifier: AV31741
2026-03-30 08:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc1d5113-4d22-579e-a8be-fd6ce0183b55 with identifier: AV31741
2026-03-30 08:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc1d5113-4d22-579e-a8be-fd6ce0183b55 with identifier: AV31741 to the API
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:40:43Z',
 'fuel_type': 'petrol',
 'id': 'dc1d5113-4d22-579e-a8be-fd6ce0183b55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV31741',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 94539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-07',
 'seller_name': None,
 'title': 'Citroen C3 1.4 VTi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV31741%27 HTTP/1.1" 200 None
2026-03-30 08:30:32 [auto1.be] INFO: Saving data for AV31741: {'auction_closing_time': 1774971643.0, 'created_time': 1774298010.913431, 'last_price_update_time': 1774859432.599867}
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AV31741') HTTP/1.1" 204 0
2026-03-30 08:30:32 [auto1.be] INFO: Found listing with ID: RJ26699
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ26699%27 HTTP/1.1" 200 None
2026-03-30 08:30:32 [auto1.be] INFO: Scrape type for RJ26699: 1
2026-03-30 08:30:32 [auto1.be] INFO: Found listing with ID: FL94389
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL94389%27 HTTP/1.1" 200 None
2026-03-30 08:30:32 [auto1.be] INFO: Scrape type for FL94389: 2
2026-03-30 08:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 561e7a63-326c-5a4d-87e2-559f68b531ff with identifier: FL94389
2026-03-30 08:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 561e7a63-326c-5a4d-87e2-559f68b531ff with scrape type 2
2026-03-30 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 561e7a63-326c-5a4d-87e2-559f68b531ff with scrape type 2
2026-03-30 08:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 561e7a63-326c-5a4d-87e2-559f68b531ff, identifier: FL94389
2026-03-30 08:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ32328/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 561e7a63-326c-5a4d-87e2-559f68b531ff with identifier: FL94389
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 08:30:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 561e7a63-326c-5a4d-87e2-559f68b531ff with identifier: FL94389
2026-03-30 08:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 561e7a63-326c-5a4d-87e2-559f68b531ff with identifier: FL94389 to the API
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:01:51Z',
 'fuel_type': 'petrol',
 'id': '561e7a63-326c-5a4d-87e2-559f68b531ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL94389',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 20078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-15',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL94389%27 HTTP/1.1" 200 None
2026-03-30 08:30:33 [auto1.be] INFO: Saving data for FL94389: {'auction_closing_time': 1774969311.0, 'created_time': 1774298019.881387, 'last_price_update_time': 1774859433.330275}
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FL94389') HTTP/1.1" 204 0
2026-03-30 08:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:33 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ87524%27 HTTP/1.1" 200 None
2026-03-30 08:30:33 [auto1.be] INFO: Scrape type for MJ87524: 2
2026-03-30 08:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e9b29e0-d457-5636-8efc-c646a68e0d22 with identifier: MJ87524
2026-03-30 08:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e9b29e0-d457-5636-8efc-c646a68e0d22 with scrape type 2
2026-03-30 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e9b29e0-d457-5636-8efc-c646a68e0d22 with scrape type 2
2026-03-30 08:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e9b29e0-d457-5636-8efc-c646a68e0d22, identifier: MJ87524
2026-03-30 08:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e9b29e0-d457-5636-8efc-c646a68e0d22 with identifier: MJ87524
2026-03-30 08:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e9b29e0-d457-5636-8efc-c646a68e0d22 with identifier: MJ87524
2026-03-30 08:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e9b29e0-d457-5636-8efc-c646a68e0d22 with identifier: MJ87524 to the API
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-31T15:24:49Z',
 'fuel_type': 'petrol',
 'id': '0e9b29e0-d457-5636-8efc-c646a68e0d22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ87524',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 203875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ87524%27 HTTP/1.1" 200 None
2026-03-30 08:30:33 [auto1.be] INFO: Saving data for MJ87524: {'auction_closing_time': 1774970689.0, 'created_time': 1774471371.994283, 'last_price_update_time': 1774859433.833487}
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ87524') HTTP/1.1" 204 0
2026-03-30 08:30:33 [auto1.be] INFO: Found listing with ID: MX59641
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX59641%27 HTTP/1.1" 200 None
2026-03-30 08:30:33 [auto1.be] INFO: Scrape type for MX59641: 1
2026-03-30 08:30:33 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1492 | hits on page: 40
2026-03-30 08:30:33 [auto1.be] INFO: Found listing with ID: EW88607
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW88607%27 HTTP/1.1" 200 None
2026-03-30 08:30:34 [auto1.be] INFO: Scrape type for EW88607: 1
2026-03-30 08:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP17023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: HL85042
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: WR16749
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: DJ32328
2026-03-30 08:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA83535%27 HTTP/1.1" 200 None
2026-03-30 08:30:34 [auto1.be] INFO: Scrape type for NA83535: 2
2026-03-30 08:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1364a632-aecb-50d4-99d0-9289ab0edaf7 with identifier: NA83535
2026-03-30 08:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1364a632-aecb-50d4-99d0-9289ab0edaf7 with scrape type 2
2026-03-30 08:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1364a632-aecb-50d4-99d0-9289ab0edaf7 with scrape type 2
2026-03-30 08:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1364a632-aecb-50d4-99d0-9289ab0edaf7, identifier: NA83535
2026-03-30 08:30:34 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/DJ32328/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 08:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1364a632-aecb-50d4-99d0-9289ab0edaf7 with identifier: NA83535
2026-03-30 08:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1364a632-aecb-50d4-99d0-9289ab0edaf7 with identifier: NA83535
2026-03-30 08:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1364a632-aecb-50d4-99d0-9289ab0edaf7 with identifier: NA83535 to the API
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:50:31Z',
 'fuel_type': 'diesel',
 'id': '1364a632-aecb-50d4-99d0-9289ab0edaf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA83535',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 183738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-11',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2017}
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA83535%27 HTTP/1.1" 200 None
2026-03-30 08:30:34 [auto1.be] INFO: Saving data for NA83535: {'auction_closing_time': 1774972231.0, 'created_time': 1773136093.690635, 'last_price_update_time': 1774859434.523339}
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NA83535') HTTP/1.1" 204 0
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: NS39608
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: FE21102
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE21102%27 HTTP/1.1" 200 None
2026-03-30 08:30:34 [auto1.be] INFO: Scrape type for FE21102: 0
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: JM82997
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: KP84190
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP84190%27 HTTP/1.1" 200 None
2026-03-30 08:30:34 [auto1.be] INFO: Scrape type for KP84190: 0
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: EH30324
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: ME19194
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW36552%27 HTTP/1.1" 200 None
2026-03-30 08:30:34 [auto1.be] INFO: Scrape type for CW36552: 0
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: XM81929
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: RL35333
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: WD23717
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD23717%27 HTTP/1.1" 200 None
2026-03-30 08:30:34 [auto1.be] INFO: Scrape type for WD23717: 0
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH74025%27 HTTP/1.1" 200 None
2026-03-30 08:30:34 [auto1.be] INFO: Scrape type for XH74025: 0
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ68089%27 HTTP/1.1" 200 None
2026-03-30 08:30:34 [auto1.be] INFO: Scrape type for HJ68089: 0
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: VP17023
2026-03-30 08:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:34 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV48703%27 HTTP/1.1" 200 None
2026-03-30 08:30:34 [auto1.be] INFO: Scrape type for BV48703: 2
2026-03-30 08:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4d94062-0400-5bc4-9cbc-b095a24f6211 with identifier: BV48703
2026-03-30 08:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4d94062-0400-5bc4-9cbc-b095a24f6211 with scrape type 2
2026-03-30 08:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4d94062-0400-5bc4-9cbc-b095a24f6211 with scrape type 2
2026-03-30 08:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b4d94062-0400-5bc4-9cbc-b095a24f6211, identifier: BV48703
2026-03-30 08:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b4d94062-0400-5bc4-9cbc-b095a24f6211 with identifier: BV48703
2026-03-30 08:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b4d94062-0400-5bc4-9cbc-b095a24f6211 with identifier: BV48703
2026-03-30 08:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b4d94062-0400-5bc4-9cbc-b095a24f6211 with identifier: BV48703 to the API
2026-03-30 08:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:58:00Z',
 'fuel_type': 'diesel',
 'id': 'b4d94062-0400-5bc4-9cbc-b095a24f6211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV48703',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 237500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-07',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2015}
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV48703%27 HTTP/1.1" 200 None
2026-03-30 08:30:35 [auto1.be] INFO: Saving data for BV48703: {'auction_closing_time': 1774972680.0, 'created_time': 1773136197.192018, 'last_price_update_time': 1774859435.230448}
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV48703') HTTP/1.1" 204 0
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: CF49225
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: JH90909
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH90909%27 HTTP/1.1" 200 None
2026-03-30 08:30:35 [auto1.be] INFO: Scrape type for JH90909: 1
2026-03-30 08:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA15365/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF49225/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: ST59109
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF11904%27 HTTP/1.1" 200 None
2026-03-30 08:30:35 [auto1.be] INFO: Scrape type for XF11904: 0
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: HA15365
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: UT07561
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: GN58348
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN58348%27 HTTP/1.1" 200 None
2026-03-30 08:30:35 [auto1.be] INFO: Scrape type for GN58348: 1
2026-03-30 08:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: NN50309
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: RD52510
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: AV31741
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV31741%27 HTTP/1.1" 200 None
2026-03-30 08:30:35 [auto1.be] INFO: Scrape type for AV31741: 0
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: RJ26699
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: XW45158
2026-03-30 08:30:35 [auto1.be] INFO: Found listing with ID: SE67148
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE67148%27 HTTP/1.1" 200 None
2026-03-30 08:30:35 [auto1.be] INFO: Scrape type for SE67148: 2
2026-03-30 08:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 875c3cda-bff1-529b-bded-b6cd9cb9ebea with identifier: SE67148
2026-03-30 08:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875c3cda-bff1-529b-bded-b6cd9cb9ebea with scrape type 2
2026-03-30 08:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 875c3cda-bff1-529b-bded-b6cd9cb9ebea with scrape type 2
2026-03-30 08:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 875c3cda-bff1-529b-bded-b6cd9cb9ebea, identifier: SE67148
2026-03-30 08:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 875c3cda-bff1-529b-bded-b6cd9cb9ebea with identifier: SE67148
2026-03-30 08:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 875c3cda-bff1-529b-bded-b6cd9cb9ebea with identifier: SE67148
2026-03-30 08:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 875c3cda-bff1-529b-bded-b6cd9cb9ebea with identifier: SE67148 to the API
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:58:01Z',
 'fuel_type': 'diesel',
 'id': '875c3cda-bff1-529b-bded-b6cd9cb9ebea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE67148',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 310268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Classic',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Classic',
 'year': 2013}
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE67148%27 HTTP/1.1" 200 None
2026-03-30 08:30:35 [auto1.be] INFO: Saving data for SE67148: {'auction_closing_time': 1774972681.0, 'created_time': 1773135679.694051, 'last_price_update_time': 1774859435.989212}
2026-03-30 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SE67148') HTTP/1.1" 204 0
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: FL94389
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL94389%27 HTTP/1.1" 200 None
2026-03-30 08:30:36 [auto1.be] INFO: Scrape type for FL94389: 0
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ87524%27 HTTP/1.1" 200 None
2026-03-30 08:30:36 [auto1.be] INFO: Scrape type for MJ87524: 0
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: MX59641
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: KP55338
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: ME39543
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME39543%27 HTTP/1.1" 200 None
2026-03-30 08:30:36 [auto1.be] INFO: Scrape type for ME39543: 2
2026-03-30 08:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1222bd8d-ac8b-58b3-9a8e-9dff6fe19aad with identifier: ME39543
2026-03-30 08:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1222bd8d-ac8b-58b3-9a8e-9dff6fe19aad with scrape type 2
2026-03-30 08:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1222bd8d-ac8b-58b3-9a8e-9dff6fe19aad with scrape type 2
2026-03-30 08:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1222bd8d-ac8b-58b3-9a8e-9dff6fe19aad, identifier: ME39543
2026-03-30 08:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1222bd8d-ac8b-58b3-9a8e-9dff6fe19aad with identifier: ME39543
2026-03-30 08:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1222bd8d-ac8b-58b3-9a8e-9dff6fe19aad with identifier: ME39543
2026-03-30 08:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1222bd8d-ac8b-58b3-9a8e-9dff6fe19aad with identifier: ME39543 to the API
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:13:36Z',
 'fuel_type': 'petrol',
 'id': '1222bd8d-ac8b-58b3-9a8e-9dff6fe19aad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME39543',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 96903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-05',
 'seller_name': None,
 'title': 'BMW X2 sDrive 18i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2019}
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME39543%27 HTTP/1.1" 200 None
2026-03-30 08:30:36 [auto1.be] INFO: Saving data for ME39543: {'auction_closing_time': 1774970016.0, 'created_time': 1774092707.110619, 'last_price_update_time': 1774859436.606874}
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ME39543') HTTP/1.1" 204 0
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: EW88607
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA83535%27 HTTP/1.1" 200 None
2026-03-30 08:30:36 [auto1.be] INFO: Scrape type for NA83535: 0
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV48703%27 HTTP/1.1" 200 None
2026-03-30 08:30:36 [auto1.be] INFO: Scrape type for BV48703: 0
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: JH90909
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: UT07561
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: GN58348
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: XW45158
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: SE67148
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE67148%27 HTTP/1.1" 200 None
2026-03-30 08:30:36 [auto1.be] INFO: Scrape type for SE67148: 0
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: KP55338
2026-03-30 08:30:36 [auto1.be] INFO: Found listing with ID: ME39543
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME39543%27 HTTP/1.1" 200 None
2026-03-30 08:30:36 [auto1.be] INFO: Scrape type for ME39543: 0
2026-03-30 08:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RJ26699/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW88607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX59641/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH90909/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN58348/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ32328> (referer: https://www.auto1.com/v1/car-details-view/DJ32328/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP17023> (referer: https://www.auto1.com/v1/car-details-view/VP17023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ba0c575-7abb-5721-812f-c08d47d0b6fb with identifier: DJ32328
2026-03-30 08:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb with scrape type 1
2026-03-30 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_54cd19997a8bdbf70655a3a52757ed75.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_54cd19997a8bdbf70655a3a52757ed75.jpg not downloaded yet
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_390066b10468e161387344204827d057.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_390066b10468e161387344204827d057.jpg not downloaded yet
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_c5fb6fa6c9773e11791482ce72013dab.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_c5fb6fa6c9773e11791482ce72013dab.jpg not downloaded yet
2026-03-30 08:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bb026aa-6679-59b8-a44a-57db14db66c8 with identifier: VP17023
2026-03-30 08:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bb026aa-6679-59b8-a44a-57db14db66c8 with scrape type 1
2026-03-30 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bb026aa-6679-59b8-a44a-57db14db66c8
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F30%252F6d309232dd37a25aaafaf11cd66e06ab%252Fpa%252FVP17023_e264ba64e8d52e56d113c92542f99f2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_e264ba64e8d52e56d113c92542f99f2b.jpg already downloaded
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F30%252F6d309232dd37a25aaafaf11cd66e06ab%252Fpa%252FVP17023_bc7b667c343de8ffb62c137bfac7f660.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_bc7b667c343de8ffb62c137bfac7f660.jpg already downloaded
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F30%252F6d309232dd37a25aaafaf11cd66e06ab%252Fpa%252FVP17023_6b389542b193a7338e217d03507cf121.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_6b389542b193a7338e217d03507cf121.jpg already downloaded
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F30%252F6d309232dd37a25aaafaf11cd66e06ab%252Fpa%252FVP17023_01f1a2ae583a6c4d1bffa47fce0e0d45.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_01f1a2ae583a6c4d1bffa47fce0e0d45.jpg already downloaded
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F30%252F6d309232dd37a25aaafaf11cd66e06ab%252Fpa%252FVP17023_5f6baff4a5dfb7177a2933c6126b3f79.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_5f6baff4a5dfb7177a2933c6126b3f79.jpg already downloaded
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F30%252F6d309232dd37a25aaafaf11cd66e06ab%252Fpa%252FVP17023_00de9b9905ba88bc4dd9147049b4c2db.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_00de9b9905ba88bc4dd9147049b4c2db.jpg already downloaded
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F30%252F6d309232dd37a25aaafaf11cd66e06ab%252Fpa%252FVP17023_c69c659b450c77c3a2fc93c23d39aeba.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_c69c659b450c77c3a2fc93c23d39aeba.jpg already downloaded
2026-03-30 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F30%252F6d309232dd37a25aaafaf11cd66e06ab%252Fpa%252FVP17023_a4472bbc670c3c37110f9547bd2a9a8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_a4472bbc670c3c37110f9547bd2a9a8c.jpg already downloaded
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F30%252F6d309232dd37a25aaafaf11cd66e06ab%252Fpa%252FVP17023_f4ba42679bec1360e501faaa607491ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_f4ba42679bec1360e501faaa607491ac.jpg already downloaded
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F30%252F6d309232dd37a25aaafaf11cd66e06ab%252Fpa%252FVP17023_33264089a24e8af7a7096ebf3b09703e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_33264089a24e8af7a7096ebf3b09703e.jpg already downloaded
2026-03-30 08:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7bb026aa-6679-59b8-a44a-57db14db66c8, identifier: VP17023
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_50fcbf8e7e4cd785435c1c3f095218b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_50fcbf8e7e4cd785435c1c3f095218b5.jpg not downloaded yet
2026-03-30 08:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7bb026aa-6679-59b8-a44a-57db14db66c8 with identifier: VP17023
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 08:30:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7bb026aa-6679-59b8-a44a-57db14db66c8 with identifier: VP17023
2026-03-30 08:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7bb026aa-6679-59b8-a44a-57db14db66c8 with identifier: VP17023 to the API
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VP17023>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:09:20Z',
 'fuel_type': 'hybrid',
 'id': '7bb026aa-6679-59b8-a44a-57db14db66c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP17023',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 158990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_e264ba64e8d52e56d113c92542f99f2b.jpg',
                'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_bc7b667c343de8ffb62c137bfac7f660.jpg',
                'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_6b389542b193a7338e217d03507cf121.jpg',
                'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_01f1a2ae583a6c4d1bffa47fce0e0d45.jpg',
                'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_5f6baff4a5dfb7177a2933c6126b3f79.jpg',
                'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_00de9b9905ba88bc4dd9147049b4c2db.jpg',
                'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_c69c659b450c77c3a2fc93c23d39aeba.jpg',
                'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_a4472bbc670c3c37110f9547bd2a9a8c.jpg',
                'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_f4ba42679bec1360e501faaa607491ac.jpg',
                'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_33264089a24e8af7a7096ebf3b09703e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb026aa-6679-59b8-a44a-57db14db66c8/7bb026aa-6679-59b8-a44a-57db14db66c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_e264ba64e8d52e56d113c92542f99f2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb026aa-6679-59b8-a44a-57db14db66c8/7bb026aa-6679-59b8-a44a-57db14db66c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_bc7b667c343de8ffb62c137bfac7f660.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb026aa-6679-59b8-a44a-57db14db66c8/7bb026aa-6679-59b8-a44a-57db14db66c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_6b389542b193a7338e217d03507cf121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb026aa-6679-59b8-a44a-57db14db66c8/7bb026aa-6679-59b8-a44a-57db14db66c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_01f1a2ae583a6c4d1bffa47fce0e0d45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb026aa-6679-59b8-a44a-57db14db66c8/7bb026aa-6679-59b8-a44a-57db14db66c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_5f6baff4a5dfb7177a2933c6126b3f79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb026aa-6679-59b8-a44a-57db14db66c8/7bb026aa-6679-59b8-a44a-57db14db66c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_00de9b9905ba88bc4dd9147049b4c2db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb026aa-6679-59b8-a44a-57db14db66c8/7bb026aa-6679-59b8-a44a-57db14db66c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_c69c659b450c77c3a2fc93c23d39aeba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb026aa-6679-59b8-a44a-57db14db66c8/7bb026aa-6679-59b8-a44a-57db14db66c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_a4472bbc670c3c37110f9547bd2a9a8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb026aa-6679-59b8-a44a-57db14db66c8/7bb026aa-6679-59b8-a44a-57db14db66c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_f4ba42679bec1360e501faaa607491ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb026aa-6679-59b8-a44a-57db14db66c8/7bb026aa-6679-59b8-a44a-57db14db66c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/30/6d309232dd37a25aaafaf11cd66e06ab/pa/VP17023_33264089a24e8af7a7096ebf3b09703e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 225 GT',
 'transmission': 'automatic',
 'trim': '225 GT',
 'year': 2022}
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP17023%27 HTTP/1.1" 200 None
2026-03-30 08:30:38 [auto1.be] INFO: Saving data for VP17023: {'created_time': 1774859438.615463, 'last_price_update_time': 1774859438.615475, 'auction_closing_time': 1774969760.0}
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP17023') HTTP/1.1" 204 0
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_79b44b2dc4b9f0b312c84daf6f81512a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_79b44b2dc4b9f0b312c84daf6f81512a.jpg not downloaded yet
2026-03-30 08:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RJ26699> (referer: https://www.auto1.com/v1/car-details-view/RJ26699/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX59641> (referer: https://www.auto1.com/v1/car-details-view/MX59641/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:38 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1492 | hits on page: 40
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_961ef837fcea7b532ff4bd05e87b31c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_961ef837fcea7b532ff4bd05e87b31c6.jpg not downloaded yet
2026-03-30 08:30:38 [auto1.be] INFO: Found listing with ID: RN25296
2026-03-30 08:30:38 [auto1.be] INFO: Found listing with ID: CD49334
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD49334%27 HTTP/1.1" 200 None
2026-03-30 08:30:38 [auto1.be] INFO: Scrape type for CD49334: 1
2026-03-30 08:30:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_6a3395abe059f346cb19fc7f1ee514c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_6a3395abe059f346cb19fc7f1ee514c6.jpg not downloaded yet
2026-03-30 08:30:38 [auto1.be] INFO: Found listing with ID: SG70291
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG70291%27 HTTP/1.1" 200 None
2026-03-30 08:30:38 [auto1.be] INFO: Scrape type for SG70291: 1
2026-03-30 08:30:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_d82d64a2af6e3188a4219bc363996262.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_d82d64a2af6e3188a4219bc363996262.jpg not downloaded yet
2026-03-30 08:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA15365> (referer: https://www.auto1.com/v1/car-details-view/HA15365/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:38 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15920%27 HTTP/1.1" 200 None
2026-03-30 08:30:38 [auto1.be] INFO: Scrape type for MB15920: 2
2026-03-30 08:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 511efb27-ef0a-5c95-8f0a-33a6989d0107 with identifier: MB15920
2026-03-30 08:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 511efb27-ef0a-5c95-8f0a-33a6989d0107 with scrape type 2
2026-03-30 08:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 511efb27-ef0a-5c95-8f0a-33a6989d0107 with scrape type 2
2026-03-30 08:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 511efb27-ef0a-5c95-8f0a-33a6989d0107, identifier: MB15920
2026-03-30 08:30:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_db4e7dea67bffa69ff3fa9f5e95a1d63.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_db4e7dea67bffa69ff3fa9f5e95a1d63.jpg not downloaded yet
2026-03-30 08:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 511efb27-ef0a-5c95-8f0a-33a6989d0107 with identifier: MB15920
2026-03-30 08:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 511efb27-ef0a-5c95-8f0a-33a6989d0107 with identifier: MB15920
2026-03-30 08:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 511efb27-ef0a-5c95-8f0a-33a6989d0107 with identifier: MB15920 to the API
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 201,
 'expiration_date': '2026-03-31T15:50:06Z',
 'fuel_type': 'diesel',
 'id': '511efb27-ef0a-5c95-8f0a-33a6989d0107',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB15920',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 130645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-01',
 'seller_name': None,
 'title': 'BMW 5er 520d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15920%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [auto1.be] INFO: Saving data for MB15920: {'auction_closing_time': 1774972206.0, 'created_time': 1774038774.784671, 'last_price_update_time': 1774859439.448641}
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MB15920') HTTP/1.1" 204 0
2026-03-30 08:30:39 [auto1.be] INFO: Found listing with ID: EU38310
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU38310%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [auto1.be] INFO: Scrape type for EU38310: 1
2026-03-30 08:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5b38bf4-c379-5ddc-9f46-01d567bd8e5f with identifier: RJ26699
2026-03-30 08:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5b38bf4-c379-5ddc-9f46-01d567bd8e5f with scrape type 1
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5b38bf4-c379-5ddc-9f46-01d567bd8e5f
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faf%252F3daf271b40614b6f7d5adfba33d6aa37%252Fpa%252FRJ26699_e296cf683662b6dbd7094f7ec89cd436.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_e296cf683662b6dbd7094f7ec89cd436.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faf%252F3daf271b40614b6f7d5adfba33d6aa37%252Fpa%252FRJ26699_50c9f63495f36aafbd20a2c5e0290861.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_50c9f63495f36aafbd20a2c5e0290861.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faf%252F3daf271b40614b6f7d5adfba33d6aa37%252Fpa%252FRJ26699_90806559fe581869cd90a5727a1c940c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_90806559fe581869cd90a5727a1c940c.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faf%252F3daf271b40614b6f7d5adfba33d6aa37%252Fpa%252FRJ26699_4de57947ee683b73025d3746f3bd6976.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_4de57947ee683b73025d3746f3bd6976.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faf%252F3daf271b40614b6f7d5adfba33d6aa37%252Fpa%252FRJ26699_754a6a83ed62afbdd9c33c2184a9b86a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_754a6a83ed62afbdd9c33c2184a9b86a.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faf%252F3daf271b40614b6f7d5adfba33d6aa37%252Fpa%252FRJ26699_dd8ff40659162853cc4658a010d8dd0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_dd8ff40659162853cc4658a010d8dd0d.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faf%252F3daf271b40614b6f7d5adfba33d6aa37%252Fpa%252FRJ26699_cd38853c6801f5b54f3251c1e501987b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_cd38853c6801f5b54f3251c1e501987b.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faf%252F3daf271b40614b6f7d5adfba33d6aa37%252Fpa%252FRJ26699_ad8e1e7873f82f383877f797fcad992d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_ad8e1e7873f82f383877f797fcad992d.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faf%252F3daf271b40614b6f7d5adfba33d6aa37%252Fpa%252FRJ26699_d0b32fe35f609b56fc861b87fc4efdeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_d0b32fe35f609b56fc861b87fc4efdeb.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Faf%252F3daf271b40614b6f7d5adfba33d6aa37%252Fpa%252FRJ26699_d4ef03409b0e41472f43c6195fd23038.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_d4ef03409b0e41472f43c6195fd23038.jpg already downloaded
2026-03-30 08:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e5b38bf4-c379-5ddc-9f46-01d567bd8e5f, identifier: RJ26699
2026-03-30 08:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55d2c2d2-f1af-5850-8bd1-7d9c03864b78 with identifier: MX59641
2026-03-30 08:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55d2c2d2-f1af-5850-8bd1-7d9c03864b78 with scrape type 1
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55d2c2d2-f1af-5850-8bd1-7d9c03864b78
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fdd%252Fe8dd86594bbfb95f586b506a22e0cc40%252Fpa%252FMX59641_c7e3efae8d2258a2ae0a667ee426ce3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_c7e3efae8d2258a2ae0a667ee426ce3d.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fdd%252Fe8dd86594bbfb95f586b506a22e0cc40%252Fpa%252FMX59641_a3d74f7359e5bb8b75ea8c74ec0d3549.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_a3d74f7359e5bb8b75ea8c74ec0d3549.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fdd%252Fe8dd86594bbfb95f586b506a22e0cc40%252Fpa%252FMX59641_a3792bb9181a552810a7367b29903d73.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_a3792bb9181a552810a7367b29903d73.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fdd%252Fe8dd86594bbfb95f586b506a22e0cc40%252Fpa%252FMX59641_85a176154dc5ce2ad862f8272fec4022.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_85a176154dc5ce2ad862f8272fec4022.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fdd%252Fe8dd86594bbfb95f586b506a22e0cc40%252Fpa%252FMX59641_7d08e55f407920ba8f090482cac040e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_7d08e55f407920ba8f090482cac040e1.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fdd%252Fe8dd86594bbfb95f586b506a22e0cc40%252Fpa%252FMX59641_7dd99a525e711ac5424ca4c5b10d5708.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_7dd99a525e711ac5424ca4c5b10d5708.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fdd%252Fe8dd86594bbfb95f586b506a22e0cc40%252Fpa%252FMX59641_8a3e0ed698ddde9e92f533368b1f7ef0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_8a3e0ed698ddde9e92f533368b1f7ef0.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fdd%252Fe8dd86594bbfb95f586b506a22e0cc40%252Fpa%252FMX59641_8845a45dab9e53afd8772fe233b79a2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_8845a45dab9e53afd8772fe233b79a2f.jpg already downloaded
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fdd%252Fe8dd86594bbfb95f586b506a22e0cc40%252Fpa%252FMX59641_a746fdaab33cb4b3cc222d5b2f5c1171.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_a746fdaab33cb4b3cc222d5b2f5c1171.jpg already downloaded
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fdd%252Fe8dd86594bbfb95f586b506a22e0cc40%252Fpa%252FMX59641_07c21e40ca541b5cf676321d9aeb0bcb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_07c21e40ca541b5cf676321d9aeb0bcb.jpg already downloaded
2026-03-30 08:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 55d2c2d2-f1af-5850-8bd1-7d9c03864b78, identifier: MX59641
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_e5149a6edd9ac00199afbea8a054f940.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_e5149a6edd9ac00199afbea8a054f940.jpg not downloaded yet
2026-03-30 08:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e5b38bf4-c379-5ddc-9f46-01d567bd8e5f with identifier: RJ26699
2026-03-30 08:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e5b38bf4-c379-5ddc-9f46-01d567bd8e5f with identifier: RJ26699
2026-03-30 08:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e5b38bf4-c379-5ddc-9f46-01d567bd8e5f with identifier: RJ26699 to the API
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RJ26699>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:02:04Z',
 'fuel_type': 'diesel',
 'id': 'e5b38bf4-c379-5ddc-9f46-01d567bd8e5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ26699',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 48547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_e296cf683662b6dbd7094f7ec89cd436.jpg',
                'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_50c9f63495f36aafbd20a2c5e0290861.jpg',
                'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_90806559fe581869cd90a5727a1c940c.jpg',
                'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_4de57947ee683b73025d3746f3bd6976.jpg',
                'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_754a6a83ed62afbdd9c33c2184a9b86a.jpg',
                'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_dd8ff40659162853cc4658a010d8dd0d.jpg',
                'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_cd38853c6801f5b54f3251c1e501987b.jpg',
                'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_ad8e1e7873f82f383877f797fcad992d.jpg',
                'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_d0b32fe35f609b56fc861b87fc4efdeb.jpg',
                'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_d4ef03409b0e41472f43c6195fd23038.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b38bf4-c379-5ddc-9f46-01d567bd8e5f/e5b38bf4-c379-5ddc-9f46-01d567bd8e5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2521570,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_e296cf683662b6dbd7094f7ec89cd436.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b38bf4-c379-5ddc-9f46-01d567bd8e5f/e5b38bf4-c379-5ddc-9f46-01d567bd8e5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2407780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_50c9f63495f36aafbd20a2c5e0290861.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b38bf4-c379-5ddc-9f46-01d567bd8e5f/e5b38bf4-c379-5ddc-9f46-01d567bd8e5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2486206,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_90806559fe581869cd90a5727a1c940c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b38bf4-c379-5ddc-9f46-01d567bd8e5f/e5b38bf4-c379-5ddc-9f46-01d567bd8e5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2288430,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_4de57947ee683b73025d3746f3bd6976.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b38bf4-c379-5ddc-9f46-01d567bd8e5f/e5b38bf4-c379-5ddc-9f46-01d567bd8e5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_754a6a83ed62afbdd9c33c2184a9b86a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b38bf4-c379-5ddc-9f46-01d567bd8e5f/e5b38bf4-c379-5ddc-9f46-01d567bd8e5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2351360,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_dd8ff40659162853cc4658a010d8dd0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b38bf4-c379-5ddc-9f46-01d567bd8e5f/e5b38bf4-c379-5ddc-9f46-01d567bd8e5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2193078,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_cd38853c6801f5b54f3251c1e501987b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b38bf4-c379-5ddc-9f46-01d567bd8e5f/e5b38bf4-c379-5ddc-9f46-01d567bd8e5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2352990,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_ad8e1e7873f82f383877f797fcad992d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b38bf4-c379-5ddc-9f46-01d567bd8e5f/e5b38bf4-c379-5ddc-9f46-01d567bd8e5f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2288855,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_d0b32fe35f609b56fc861b87fc4efdeb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b38bf4-c379-5ddc-9f46-01d567bd8e5f/e5b38bf4-c379-5ddc-9f46-01d567bd8e5f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/af/3daf271b40614b6f7d5adfba33d6aa37/pa/RJ26699_d4ef03409b0e41472f43c6195fd23038.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-06',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Kasten Trend Lang',
 'transmission': 'manual',
 'trim': 'Kasten Trend Lang',
 'year': 2017}
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ26699%27 HTTP/1.1" 200 None
2026-03-30 08:30:40 [auto1.be] INFO: Saving data for RJ26699: {'created_time': 1774859440.445265, 'last_price_update_time': 1774859440.445277, 'auction_closing_time': 1774969324.0}
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RJ26699') HTTP/1.1" 204 0
2026-03-30 08:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 55d2c2d2-f1af-5850-8bd1-7d9c03864b78 with identifier: MX59641
2026-03-30 08:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 55d2c2d2-f1af-5850-8bd1-7d9c03864b78 with identifier: MX59641
2026-03-30 08:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 55d2c2d2-f1af-5850-8bd1-7d9c03864b78 with identifier: MX59641 to the API
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MX59641>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:48:14Z',
 'fuel_type': 'diesel',
 'id': '55d2c2d2-f1af-5850-8bd1-7d9c03864b78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX59641',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 171668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_c7e3efae8d2258a2ae0a667ee426ce3d.jpg',
                'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_a3d74f7359e5bb8b75ea8c74ec0d3549.jpg',
                'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_a3792bb9181a552810a7367b29903d73.jpg',
                'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_85a176154dc5ce2ad862f8272fec4022.jpg',
                'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_7d08e55f407920ba8f090482cac040e1.jpg',
                'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_7dd99a525e711ac5424ca4c5b10d5708.jpg',
                'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_8a3e0ed698ddde9e92f533368b1f7ef0.jpg',
                'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_8845a45dab9e53afd8772fe233b79a2f.jpg',
                'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_a746fdaab33cb4b3cc222d5b2f5c1171.jpg',
                'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_07c21e40ca541b5cf676321d9aeb0bcb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d2c2d2-f1af-5850-8bd1-7d9c03864b78/55d2c2d2-f1af-5850-8bd1-7d9c03864b78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_c7e3efae8d2258a2ae0a667ee426ce3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d2c2d2-f1af-5850-8bd1-7d9c03864b78/55d2c2d2-f1af-5850-8bd1-7d9c03864b78_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_a3d74f7359e5bb8b75ea8c74ec0d3549.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d2c2d2-f1af-5850-8bd1-7d9c03864b78/55d2c2d2-f1af-5850-8bd1-7d9c03864b78_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_a3792bb9181a552810a7367b29903d73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d2c2d2-f1af-5850-8bd1-7d9c03864b78/55d2c2d2-f1af-5850-8bd1-7d9c03864b78_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_85a176154dc5ce2ad862f8272fec4022.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d2c2d2-f1af-5850-8bd1-7d9c03864b78/55d2c2d2-f1af-5850-8bd1-7d9c03864b78_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_7d08e55f407920ba8f090482cac040e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d2c2d2-f1af-5850-8bd1-7d9c03864b78/55d2c2d2-f1af-5850-8bd1-7d9c03864b78_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_7dd99a525e711ac5424ca4c5b10d5708.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d2c2d2-f1af-5850-8bd1-7d9c03864b78/55d2c2d2-f1af-5850-8bd1-7d9c03864b78_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_8a3e0ed698ddde9e92f533368b1f7ef0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d2c2d2-f1af-5850-8bd1-7d9c03864b78/55d2c2d2-f1af-5850-8bd1-7d9c03864b78_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_8845a45dab9e53afd8772fe233b79a2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d2c2d2-f1af-5850-8bd1-7d9c03864b78/55d2c2d2-f1af-5850-8bd1-7d9c03864b78_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_a746fdaab33cb4b3cc222d5b2f5c1171.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d2c2d2-f1af-5850-8bd1-7d9c03864b78/55d2c2d2-f1af-5850-8bd1-7d9c03864b78_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/dd/e8dd86594bbfb95f586b506a22e0cc40/pa/MX59641_07c21e40ca541b5cf676321d9aeb0bcb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX59641%27 HTTP/1.1" 200 None
2026-03-30 08:30:40 [auto1.be] INFO: Saving data for MX59641: {'created_time': 1774859440.799001, 'last_price_update_time': 1774859440.799024, 'auction_closing_time': 1774972094.0}
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MX59641') HTTP/1.1" 204 0
2026-03-30 08:30:40 [auto1.be] INFO: Found listing with ID: NL96046
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL96046%27 HTTP/1.1" 200 None
2026-03-30 08:30:40 [auto1.be] INFO: Scrape type for NL96046: 1
2026-03-30 08:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH90909> (referer: https://www.auto1.com/v1/car-details-view/JH90909/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f8a7a03-9f87-5347-9a7d-ddd2917c9b54 with identifier: HA15365
2026-03-30 08:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f8a7a03-9f87-5347-9a7d-ddd2917c9b54 with scrape type 1
2026-03-30 08:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f8a7a03-9f87-5347-9a7d-ddd2917c9b54
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd3%252F64d3899a236969ceb3553c5d31ca8b24%252Fpa%252FHA15365_337eb50afc29609ea0c12dc21bef9c52.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_337eb50afc29609ea0c12dc21bef9c52.jpg already downloaded
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd3%252F64d3899a236969ceb3553c5d31ca8b24%252Fpa%252FHA15365_f2183dabb7548d06916353e625f768ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_f2183dabb7548d06916353e625f768ad.jpg already downloaded
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd3%252F64d3899a236969ceb3553c5d31ca8b24%252Fpa%252FHA15365_ab21bdf0dd63dc1941843826ecc1c57c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_ab21bdf0dd63dc1941843826ecc1c57c.jpg already downloaded
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd3%252F64d3899a236969ceb3553c5d31ca8b24%252Fpa%252FHA15365_8545bdee162f58c2713e826198acfea6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_8545bdee162f58c2713e826198acfea6.jpg already downloaded
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd3%252F64d3899a236969ceb3553c5d31ca8b24%252Fpa%252FHA15365_95e673c9a6678810de4926f1134a27c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_95e673c9a6678810de4926f1134a27c5.jpg already downloaded
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd3%252F64d3899a236969ceb3553c5d31ca8b24%252Fpa%252FHA15365_8a2600a03cba2928ffb0d1ae497b6d6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_8a2600a03cba2928ffb0d1ae497b6d6d.jpg already downloaded
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd3%252F64d3899a236969ceb3553c5d31ca8b24%252Fpa%252FHA15365_435fb92dd20413abaa7de3a6b83d2a03.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_435fb92dd20413abaa7de3a6b83d2a03.jpg already downloaded
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd3%252F64d3899a236969ceb3553c5d31ca8b24%252Fpa%252FHA15365_c67665b950897e6244de226cbd8dab3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_c67665b950897e6244de226cbd8dab3b.jpg already downloaded
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd3%252F64d3899a236969ceb3553c5d31ca8b24%252Fpa%252FHA15365_d9bb79174457294b14de89550371d366.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_d9bb79174457294b14de89550371d366.jpg already downloaded
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd3%252F64d3899a236969ceb3553c5d31ca8b24%252Fpa%252FHA15365_a052d58e04f916d3933062ad86577ced.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_a052d58e04f916d3933062ad86577ced.jpg already downloaded
2026-03-30 08:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f8a7a03-9f87-5347-9a7d-ddd2917c9b54, identifier: HA15365
2026-03-30 08:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_390066b10468e161387344204827d057.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:41 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56663%27 HTTP/1.1" 200 None
2026-03-30 08:30:41 [auto1.be] INFO: Scrape type for CW56663: 2
2026-03-30 08:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee8117f5-fff4-5f57-beac-f725f5d3f34e with identifier: CW56663
2026-03-30 08:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee8117f5-fff4-5f57-beac-f725f5d3f34e with scrape type 2
2026-03-30 08:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee8117f5-fff4-5f57-beac-f725f5d3f34e with scrape type 2
2026-03-30 08:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee8117f5-fff4-5f57-beac-f725f5d3f34e, identifier: CW56663
2026-03-30 08:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f8a7a03-9f87-5347-9a7d-ddd2917c9b54 with identifier: HA15365
2026-03-30 08:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f8a7a03-9f87-5347-9a7d-ddd2917c9b54 with identifier: HA15365
2026-03-30 08:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f8a7a03-9f87-5347-9a7d-ddd2917c9b54 with identifier: HA15365 to the API
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HA15365>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 211,
 'expiration_date': '2026-03-31T15:08:30Z',
 'fuel_type': 'hybrid',
 'id': '9f8a7a03-9f87-5347-9a7d-ddd2917c9b54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA15365',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 91239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_337eb50afc29609ea0c12dc21bef9c52.jpg',
                'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_f2183dabb7548d06916353e625f768ad.jpg',
                'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_ab21bdf0dd63dc1941843826ecc1c57c.jpg',
                'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_8545bdee162f58c2713e826198acfea6.jpg',
                'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_95e673c9a6678810de4926f1134a27c5.jpg',
                'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_8a2600a03cba2928ffb0d1ae497b6d6d.jpg',
                'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_435fb92dd20413abaa7de3a6b83d2a03.jpg',
                'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_c67665b950897e6244de226cbd8dab3b.jpg',
                'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_d9bb79174457294b14de89550371d366.jpg',
                'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_a052d58e04f916d3933062ad86577ced.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8a7a03-9f87-5347-9a7d-ddd2917c9b54/9f8a7a03-9f87-5347-9a7d-ddd2917c9b54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_337eb50afc29609ea0c12dc21bef9c52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8a7a03-9f87-5347-9a7d-ddd2917c9b54/9f8a7a03-9f87-5347-9a7d-ddd2917c9b54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_f2183dabb7548d06916353e625f768ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8a7a03-9f87-5347-9a7d-ddd2917c9b54/9f8a7a03-9f87-5347-9a7d-ddd2917c9b54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_ab21bdf0dd63dc1941843826ecc1c57c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8a7a03-9f87-5347-9a7d-ddd2917c9b54/9f8a7a03-9f87-5347-9a7d-ddd2917c9b54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_8545bdee162f58c2713e826198acfea6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8a7a03-9f87-5347-9a7d-ddd2917c9b54/9f8a7a03-9f87-5347-9a7d-ddd2917c9b54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_95e673c9a6678810de4926f1134a27c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8a7a03-9f87-5347-9a7d-ddd2917c9b54/9f8a7a03-9f87-5347-9a7d-ddd2917c9b54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_8a2600a03cba2928ffb0d1ae497b6d6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8a7a03-9f87-5347-9a7d-ddd2917c9b54/9f8a7a03-9f87-5347-9a7d-ddd2917c9b54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_435fb92dd20413abaa7de3a6b83d2a03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8a7a03-9f87-5347-9a7d-ddd2917c9b54/9f8a7a03-9f87-5347-9a7d-ddd2917c9b54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_c67665b950897e6244de226cbd8dab3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8a7a03-9f87-5347-9a7d-ddd2917c9b54/9f8a7a03-9f87-5347-9a7d-ddd2917c9b54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_d9bb79174457294b14de89550371d366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8a7a03-9f87-5347-9a7d-ddd2917c9b54/9f8a7a03-9f87-5347-9a7d-ddd2917c9b54_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d3/64d3899a236969ceb3553c5d31ca8b24/pa/HA15365_a052d58e04f916d3933062ad86577ced.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Recharge Plug-in Hybrid Inscription Expression '
          '2WD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression 2WD',
 'year': 2022}
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA15365%27 HTTP/1.1" 200 None
2026-03-30 08:30:41 [auto1.be] INFO: Saving data for HA15365: {'created_time': 1774859441.550616, 'last_price_update_time': 1774859441.550627, 'auction_closing_time': 1774969710.0}
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HA15365') HTTP/1.1" 204 0
2026-03-30 08:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_c5fb6fa6c9773e11791482ce72013dab.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_54cd19997a8bdbf70655a3a52757ed75.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee8117f5-fff4-5f57-beac-f725f5d3f34e with identifier: CW56663
2026-03-30 08:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee8117f5-fff4-5f57-beac-f725f5d3f34e with identifier: CW56663
2026-03-30 08:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee8117f5-fff4-5f57-beac-f725f5d3f34e with identifier: CW56663 to the API
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:39:42Z',
 'fuel_type': 'diesel',
 'id': 'ee8117f5-fff4-5f57-beac-f725f5d3f34e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW56663',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 335850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-07',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56663%27 HTTP/1.1" 200 None
2026-03-30 08:30:41 [auto1.be] INFO: Saving data for CW56663: {'auction_closing_time': 1774971582.0, 'created_time': 1773132812.940812, 'last_price_update_time': 1774859441.895893}
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CW56663') HTTP/1.1" 204 0
2026-03-30 08:30:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_79b44b2dc4b9f0b312c84daf6f81512a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_50fcbf8e7e4cd785435c1c3f095218b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:41 [auto1.be] INFO: Found listing with ID: GL12776
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL12776%27 HTTP/1.1" 200 None
2026-03-30 08:30:41 [auto1.be] INFO: Scrape type for GL12776: 2
2026-03-30 08:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59a9bf64-cab1-5cfd-a508-1b564cf03b6f with identifier: GL12776
2026-03-30 08:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59a9bf64-cab1-5cfd-a508-1b564cf03b6f with scrape type 2
2026-03-30 08:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59a9bf64-cab1-5cfd-a508-1b564cf03b6f with scrape type 2
2026-03-30 08:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 59a9bf64-cab1-5cfd-a508-1b564cf03b6f, identifier: GL12776
2026-03-30 08:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 59a9bf64-cab1-5cfd-a508-1b564cf03b6f with identifier: GL12776
2026-03-30 08:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 59a9bf64-cab1-5cfd-a508-1b564cf03b6f with identifier: GL12776
2026-03-30 08:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 59a9bf64-cab1-5cfd-a508-1b564cf03b6f with identifier: GL12776 to the API
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:04:20Z',
 'fuel_type': 'petrol',
 'id': '59a9bf64-cab1-5cfd-a508-1b564cf03b6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL12776',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 139829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-16',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL12776%27 HTTP/1.1" 200 None
2026-03-30 08:30:42 [auto1.be] INFO: Saving data for GL12776: {'auction_closing_time': 1774969460.0, 'created_time': 1774298111.141203, 'last_price_update_time': 1774859442.362565}
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GL12776') HTTP/1.1" 204 0
2026-03-30 08:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_961ef837fcea7b532ff4bd05e87b31c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:42 [auto1.be] INFO: Found listing with ID: FA29131
2026-03-30 08:30:42 [auto1.be] INFO: Found listing with ID: MA67469
2026-03-30 08:30:42 [auto1.be] INFO: Found listing with ID: FL73906
2026-03-30 08:30:42 [auto1.be] INFO: Found listing with ID: KL19623
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL19623%27 HTTP/1.1" 200 None
2026-03-30 08:30:42 [auto1.be] INFO: Scrape type for KL19623: 2
2026-03-30 08:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a77ca9bc-3082-5146-8699-5a1e0550731a with identifier: KL19623
2026-03-30 08:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a77ca9bc-3082-5146-8699-5a1e0550731a with scrape type 2
2026-03-30 08:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a77ca9bc-3082-5146-8699-5a1e0550731a with scrape type 2
2026-03-30 08:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a77ca9bc-3082-5146-8699-5a1e0550731a, identifier: KL19623
2026-03-30 08:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6db47c40-0b2b-54fa-99d0-89c6853bf2fa with identifier: JH90909
2026-03-30 08:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa with scrape type 1
2026-03-30 08:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_35a4547f22efbbf9880ca05a6d314c8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_35a4547f22efbbf9880ca05a6d314c8f.jpg not downloaded yet
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca8bf150>
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2122
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_390066b10468e161387344204827d057.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_390066b10468e161387344204827d057.jpg saved to cache
2026-03-30 08:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c95c8090>
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_c5fb6fa6c9773e11791482ce72013dab.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_c5fb6fa6c9773e11791482ce72013dab.jpg saved to cache
2026-03-30 08:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c95ca990>
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_54cd19997a8bdbf70655a3a52757ed75.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_54cd19997a8bdbf70655a3a52757ed75.jpg saved to cache
2026-03-30 08:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb
2026-03-30 08:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a77ca9bc-3082-5146-8699-5a1e0550731a with identifier: KL19623
2026-03-30 08:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a77ca9bc-3082-5146-8699-5a1e0550731a with identifier: KL19623
2026-03-30 08:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a77ca9bc-3082-5146-8699-5a1e0550731a with identifier: KL19623 to the API
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:20:31Z',
 'fuel_type': 'diesel',
 'id': 'a77ca9bc-3082-5146-8699-5a1e0550731a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL19623',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 130378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-21',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2013}
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL19623%27 HTTP/1.1" 200 None
2026-03-30 08:30:43 [auto1.be] INFO: Saving data for KL19623: {'auction_closing_time': 1774970431.0, 'created_time': 1774125175.480026, 'last_price_update_time': 1774859443.258779}
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KL19623') HTTP/1.1" 204 0
2026-03-30 08:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_6a3395abe059f346cb19fc7f1ee514c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_db4e7dea67bffa69ff3fa9f5e95a1d63.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_e5149a6edd9ac00199afbea8a054f940.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:43 [auto1.be] INFO: Found listing with ID: TR13838
2026-03-30 08:30:43 [auto1.be] INFO: Found listing with ID: LW89201
2026-03-30 08:30:43 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC05502%27 HTTP/1.1" 200 None
2026-03-30 08:30:43 [auto1.be] INFO: Scrape type for ZC05502: 2
2026-03-30 08:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b2ee45-83e8-5f11-adfe-4b023a613aa7 with identifier: ZC05502
2026-03-30 08:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b2ee45-83e8-5f11-adfe-4b023a613aa7 with scrape type 2
2026-03-30 08:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46b2ee45-83e8-5f11-adfe-4b023a613aa7 with scrape type 2
2026-03-30 08:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46b2ee45-83e8-5f11-adfe-4b023a613aa7, identifier: ZC05502
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_fa4cc4a4c53c47b328986600681564dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_fa4cc4a4c53c47b328986600681564dc.jpg not downloaded yet
2026-03-30 08:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9540090>
2026-03-30 08:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_79b44b2dc4b9f0b312c84daf6f81512a.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_79b44b2dc4b9f0b312c84daf6f81512a.jpg saved to cache
2026-03-30 08:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb
2026-03-30 08:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6cb56bc50>
2026-03-30 08:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_50fcbf8e7e4cd785435c1c3f095218b5.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_50fcbf8e7e4cd785435c1c3f095218b5.jpg saved to cache
2026-03-30 08:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb
2026-03-30 08:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46b2ee45-83e8-5f11-adfe-4b023a613aa7 with identifier: ZC05502
2026-03-30 08:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46b2ee45-83e8-5f11-adfe-4b023a613aa7 with identifier: ZC05502
2026-03-30 08:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46b2ee45-83e8-5f11-adfe-4b023a613aa7 with identifier: ZC05502 to the API
2026-03-30 08:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:23:46Z',
 'fuel_type': 'petrol',
 'id': '46b2ee45-83e8-5f11-adfe-4b023a613aa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC05502',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 88074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-19',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-03-30 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC05502%27 HTTP/1.1" 200 None
2026-03-30 08:30:44 [auto1.be] INFO: Saving data for ZC05502: {'auction_closing_time': 1774970626.0, 'created_time': 1773136848.541543, 'last_price_update_time': 1774859444.653466}
2026-03-30 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC05502') HTTP/1.1" 204 0
2026-03-30 08:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG70291/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:44 [auto1.be] INFO: Found listing with ID: AG54530
2026-03-30 08:30:44 [auto1.be] INFO: Found listing with ID: UU73016
2026-03-30 08:30:44 [auto1.be] INFO: Found listing with ID: YG75749
2026-03-30 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG75749%27 HTTP/1.1" 200 None
2026-03-30 08:30:44 [auto1.be] INFO: Scrape type for YG75749: 2
2026-03-30 08:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96315fc4-57f7-53d8-bb01-543a9d8e6c80 with identifier: YG75749
2026-03-30 08:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96315fc4-57f7-53d8-bb01-543a9d8e6c80 with scrape type 2
2026-03-30 08:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96315fc4-57f7-53d8-bb01-543a9d8e6c80 with scrape type 2
2026-03-30 08:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96315fc4-57f7-53d8-bb01-543a9d8e6c80, identifier: YG75749
2026-03-30 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_1c3c4641ad00098c4b26b54983e88565.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_1c3c4641ad00098c4b26b54983e88565.jpg not downloaded yet
2026-03-30 08:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_d82d64a2af6e3188a4219bc363996262.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96315fc4-57f7-53d8-bb01-543a9d8e6c80 with identifier: YG75749
2026-03-30 08:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96315fc4-57f7-53d8-bb01-543a9d8e6c80 with identifier: YG75749
2026-03-30 08:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96315fc4-57f7-53d8-bb01-543a9d8e6c80 with identifier: YG75749 to the API
2026-03-30 08:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:49:56Z',
 'fuel_type': 'diesel',
 'id': '96315fc4-57f7-53d8-bb01-543a9d8e6c80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG75749',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 157976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-14',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG75749%27 HTTP/1.1" 200 None
2026-03-30 08:30:45 [auto1.be] INFO: Saving data for YG75749: {'auction_closing_time': 1774972196.0, 'created_time': 1773693340.828345, 'last_price_update_time': 1774859445.159174}
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YG75749') HTTP/1.1" 204 0
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c955ac10>
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_961ef837fcea7b532ff4bd05e87b31c6.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_961ef837fcea7b532ff4bd05e87b31c6.jpg saved to cache
2026-03-30 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c95751d0>
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_6a3395abe059f346cb19fc7f1ee514c6.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_6a3395abe059f346cb19fc7f1ee514c6.jpg saved to cache
2026-03-30 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca785d10>
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_db4e7dea67bffa69ff3fa9f5e95a1d63.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_db4e7dea67bffa69ff3fa9f5e95a1d63.jpg saved to cache
2026-03-30 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c960dcd0>
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_e5149a6edd9ac00199afbea8a054f940.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_e5149a6edd9ac00199afbea8a054f940.jpg saved to cache
2026-03-30 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb
2026-03-30 08:30:45 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1492 | hits on page: 40
2026-03-30 08:30:45 [auto1.be] INFO: Found listing with ID: FU28808
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU28808%27 HTTP/1.1" 200 None
2026-03-30 08:30:45 [auto1.be] INFO: Scrape type for FU28808: 1
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_fae1bad0d902844a303cbc16aa8c2756.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_fae1bad0d902844a303cbc16aa8c2756.jpg not downloaded yet
2026-03-30 08:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_35a4547f22efbbf9880ca05a6d314c8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:45 [auto1.be] INFO: Found listing with ID: TY33491
2026-03-30 08:30:45 [auto1.be] INFO: Found listing with ID: HA32985
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA32985%27 HTTP/1.1" 200 None
2026-03-30 08:30:45 [auto1.be] INFO: Scrape type for HA32985: 2
2026-03-30 08:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 973bda89-0606-51aa-88a5-87b22af9f372 with identifier: HA32985
2026-03-30 08:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 973bda89-0606-51aa-88a5-87b22af9f372 with scrape type 2
2026-03-30 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 973bda89-0606-51aa-88a5-87b22af9f372 with scrape type 2
2026-03-30 08:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 973bda89-0606-51aa-88a5-87b22af9f372, identifier: HA32985
2026-03-30 08:30:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:45 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS70949%27 HTTP/1.1" 200 None
2026-03-30 08:30:45 [auto1.be] INFO: Scrape type for MS70949: 2
2026-03-30 08:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eef08dc3-532a-570b-a0e9-9ed604ffe588 with identifier: MS70949
2026-03-30 08:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eef08dc3-532a-570b-a0e9-9ed604ffe588 with scrape type 2
2026-03-30 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eef08dc3-532a-570b-a0e9-9ed604ffe588 with scrape type 2
2026-03-30 08:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eef08dc3-532a-570b-a0e9-9ed604ffe588, identifier: MS70949
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_af4d7ae09aba0438f13f91555637190d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_af4d7ae09aba0438f13f91555637190d.jpg not downloaded yet
2026-03-30 08:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 973bda89-0606-51aa-88a5-87b22af9f372 with identifier: HA32985
2026-03-30 08:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 973bda89-0606-51aa-88a5-87b22af9f372 with identifier: HA32985
2026-03-30 08:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 973bda89-0606-51aa-88a5-87b22af9f372 with identifier: HA32985 to the API
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:56:31Z',
 'fuel_type': 'diesel',
 'id': '973bda89-0606-51aa-88a5-87b22af9f372',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA32985',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 184085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-24',
 'seller_name': None,
 'title': 'BMW 4er 420d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA32985%27 HTTP/1.1" 200 None
2026-03-30 08:30:45 [auto1.be] INFO: Saving data for HA32985: {'auction_closing_time': 1774972591.0, 'created_time': 1774470957.570975, 'last_price_update_time': 1774859445.949556}
2026-03-30 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HA32985') HTTP/1.1" 204 0
2026-03-30 08:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eef08dc3-532a-570b-a0e9-9ed604ffe588 with identifier: MS70949
2026-03-30 08:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eef08dc3-532a-570b-a0e9-9ed604ffe588 with identifier: MS70949
2026-03-30 08:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eef08dc3-532a-570b-a0e9-9ed604ffe588 with identifier: MS70949 to the API
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:51:37Z',
 'fuel_type': 'diesel',
 'id': 'eef08dc3-532a-570b-a0e9-9ed604ffe588',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS70949',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 172288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-08',
 'seller_name': None,
 'title': 'Renault Kadjar 1.6 dCi Energy XMOD',
 'transmission': 'manual',
 'trim': 'XMOD',
 'year': 2017}
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS70949%27 HTTP/1.1" 200 None
2026-03-30 08:30:46 [auto1.be] INFO: Saving data for MS70949: {'auction_closing_time': 1774972297.0, 'created_time': 1773131981.571896, 'last_price_update_time': 1774859446.340179}
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MS70949') HTTP/1.1" 204 0
2026-03-30 08:30:46 [auto1.be] INFO: Found listing with ID: VU67376
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU67376%27 HTTP/1.1" 200 None
2026-03-30 08:30:46 [auto1.be] INFO: Scrape type for VU67376: 2
2026-03-30 08:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19a5c318-ae02-5f31-ae2e-2c41725a4ae8 with identifier: VU67376
2026-03-30 08:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19a5c318-ae02-5f31-ae2e-2c41725a4ae8 with scrape type 2
2026-03-30 08:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19a5c318-ae02-5f31-ae2e-2c41725a4ae8 with scrape type 2
2026-03-30 08:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 19a5c318-ae02-5f31-ae2e-2c41725a4ae8, identifier: VU67376
2026-03-30 08:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF49225> (referer: https://www.auto1.com/v1/car-details-view/CF49225/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9576050>
2026-03-30 08:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fcc%252F2ccca921588e9ddf307a01ce37b05980%252Fpa%252FDJ32328_d82d64a2af6e3188a4219bc363996262.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_d82d64a2af6e3188a4219bc363996262.jpg saved to cache
2026-03-30 08:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb
2026-03-30 08:30:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ba0c575-7abb-5721-812f-c08d47d0b6fb, skipping ID generation
2026-03-30 08:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb with scrape type 1
2026-03-30 08:30:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ba0c575-7abb-5721-812f-c08d47d0b6fb sending to next pipeline
2026-03-30 08:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5ba0c575-7abb-5721-812f-c08d47d0b6fb, identifier: DJ32328
2026-03-30 08:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_fa4cc4a4c53c47b328986600681564dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:46 [auto1.be] INFO: Found listing with ID: CX41368
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX41368%27 HTTP/1.1" 200 None
2026-03-30 08:30:46 [auto1.be] INFO: Scrape type for CX41368: 1
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_61d5416295bb328c7a606190ae49d627.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_61d5416295bb328c7a606190ae49d627.jpg not downloaded yet
2026-03-30 08:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 19a5c318-ae02-5f31-ae2e-2c41725a4ae8 with identifier: VU67376
2026-03-30 08:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 19a5c318-ae02-5f31-ae2e-2c41725a4ae8 with identifier: VU67376
2026-03-30 08:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 19a5c318-ae02-5f31-ae2e-2c41725a4ae8 with identifier: VU67376 to the API
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:12:39Z',
 'fuel_type': 'petrol',
 'id': '19a5c318-ae02-5f31-ae2e-2c41725a4ae8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU67376',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 92579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-18',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2014}
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU67376%27 HTTP/1.1" 200 None
2026-03-30 08:30:47 [auto1.be] INFO: Saving data for VU67376: {'auction_closing_time': 1774969959.0, 'created_time': 1774643568.621243, 'last_price_update_time': 1774859447.092838}
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VU67376') HTTP/1.1" 204 0
2026-03-30 08:30:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5ba0c575-7abb-5721-812f-c08d47d0b6fb with identifier: DJ32328
2026-03-30 08:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5ba0c575-7abb-5721-812f-c08d47d0b6fb with identifier: DJ32328
2026-03-30 08:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5ba0c575-7abb-5721-812f-c08d47d0b6fb with identifier: DJ32328 to the API
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_d82d64a2af6e3188a4219bc363996262.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 212,
 'expiration_date': '2026-03-31T15:08:41Z',
 'fuel_type': 'diesel',
 'id': '5ba0c575-7abb-5721-812f-c08d47d0b6fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ32328',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 106522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_54cd19997a8bdbf70655a3a52757ed75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_390066b10468e161387344204827d057.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_c5fb6fa6c9773e11791482ce72013dab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_50fcbf8e7e4cd785435c1c3f095218b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_79b44b2dc4b9f0b312c84daf6f81512a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_961ef837fcea7b532ff4bd05e87b31c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_6a3395abe059f346cb19fc7f1ee514c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_d82d64a2af6e3188a4219bc363996262.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_db4e7dea67bffa69ff3fa9f5e95a1d63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba0c575-7abb-5721-812f-c08d47d0b6fb/5ba0c575-7abb-5721-812f-c08d47d0b6fb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/cc/2ccca921588e9ddf307a01ce37b05980/pa/DJ32328_e5149a6edd9ac00199afbea8a054f940.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2020}
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ32328%27 HTTP/1.1" 200 None
2026-03-30 08:30:47 [auto1.be] INFO: Saving data for DJ32328: {'created_time': 1774859447.646545, 'last_price_update_time': 1774859447.646555, 'auction_closing_time': 1774969721.0}
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ32328') HTTP/1.1" 204 0
2026-03-30 08:30:47 [auto1.be] INFO: Found listing with ID: TS76065
2026-03-30 08:30:47 [auto1.be] INFO: Found listing with ID: TK82832
2026-03-30 08:30:47 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH79590%27 HTTP/1.1" 200 None
2026-03-30 08:30:47 [auto1.be] INFO: Scrape type for DH79590: 2
2026-03-30 08:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69ee43ef-0ec5-5060-84ad-fbbc2d070582 with identifier: DH79590
2026-03-30 08:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ee43ef-0ec5-5060-84ad-fbbc2d070582 with scrape type 2
2026-03-30 08:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69ee43ef-0ec5-5060-84ad-fbbc2d070582 with scrape type 2
2026-03-30 08:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 69ee43ef-0ec5-5060-84ad-fbbc2d070582, identifier: DH79590
2026-03-30 08:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL96046/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU38310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW88607> (referer: https://www.auto1.com/v1/car-details-view/EW88607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca6d5bd0>
2026-03-30 08:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_35a4547f22efbbf9880ca05a6d314c8f.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_35a4547f22efbbf9880ca05a6d314c8f.jpg saved to cache
2026-03-30 08:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa
2026-03-30 08:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_1c3c4641ad00098c4b26b54983e88565.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:47 [auto1.be] INFO: Found listing with ID: BT12815
2026-03-30 08:30:47 [auto1.be] INFO: Found listing with ID: PY47802
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY47802%27 HTTP/1.1" 200 None
2026-03-30 08:30:47 [auto1.be] INFO: Scrape type for PY47802: 2
2026-03-30 08:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fc57bf8-53fc-549b-a1f6-e328629ba799 with identifier: PY47802
2026-03-30 08:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fc57bf8-53fc-549b-a1f6-e328629ba799 with scrape type 2
2026-03-30 08:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fc57bf8-53fc-549b-a1f6-e328629ba799 with scrape type 2
2026-03-30 08:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5fc57bf8-53fc-549b-a1f6-e328629ba799, identifier: PY47802
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_f3b148875efb06da497cf353b14a7da6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_f3b148875efb06da497cf353b14a7da6.jpg not downloaded yet
2026-03-30 08:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 69ee43ef-0ec5-5060-84ad-fbbc2d070582 with identifier: DH79590
2026-03-30 08:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 69ee43ef-0ec5-5060-84ad-fbbc2d070582 with identifier: DH79590
2026-03-30 08:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 69ee43ef-0ec5-5060-84ad-fbbc2d070582 with identifier: DH79590 to the API
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:01:08Z',
 'fuel_type': 'petrol',
 'id': '69ee43ef-0ec5-5060-84ad-fbbc2d070582',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH79590',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 183890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-31',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2015}
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH79590%27 HTTP/1.1" 200 None
2026-03-30 08:30:48 [auto1.be] INFO: Saving data for DH79590: {'auction_closing_time': 1774969268.0, 'created_time': 1774471277.818564, 'last_price_update_time': 1774859448.282711}
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH79590') HTTP/1.1" 204 0
2026-03-30 08:30:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60051082-e946-526f-be81-a3c9ee477803 with identifier: CF49225
2026-03-30 08:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60051082-e946-526f-be81-a3c9ee477803 with scrape type 1
2026-03-30 08:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60051082-e946-526f-be81-a3c9ee477803
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F32%252F8632dae13c7098fea2969de7ee4a531f%252Fpa%252FCF49225_356cf552aba3aaa86dadc550df1a0fd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_356cf552aba3aaa86dadc550df1a0fd1.jpg already downloaded
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F32%252F8632dae13c7098fea2969de7ee4a531f%252Fpa%252FCF49225_4883d4bafdc51664ad1e9b79e164e908.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_4883d4bafdc51664ad1e9b79e164e908.jpg already downloaded
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F32%252F8632dae13c7098fea2969de7ee4a531f%252Fpa%252FCF49225_14bd3576152450ddb760eb76fef45ad8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_14bd3576152450ddb760eb76fef45ad8.jpg already downloaded
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F32%252F8632dae13c7098fea2969de7ee4a531f%252Fpa%252FCF49225_33b8bdd162c25fb36eb3693594ef58e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_33b8bdd162c25fb36eb3693594ef58e7.jpg already downloaded
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F32%252F8632dae13c7098fea2969de7ee4a531f%252Fpa%252FCF49225_32ba233ef8392e86edd1776341c1ea41.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_32ba233ef8392e86edd1776341c1ea41.jpg already downloaded
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F32%252F8632dae13c7098fea2969de7ee4a531f%252Fpa%252FCF49225_39a93cf05f946721effeb84b6b036da4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_39a93cf05f946721effeb84b6b036da4.jpg already downloaded
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F32%252F8632dae13c7098fea2969de7ee4a531f%252Fpa%252FCF49225_0fa653fc50a34b75c2e223c7c24f6e01.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_0fa653fc50a34b75c2e223c7c24f6e01.jpg already downloaded
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F32%252F8632dae13c7098fea2969de7ee4a531f%252Fpa%252FCF49225_7f4c3e41a07e36c2c0480c79d59db858.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_7f4c3e41a07e36c2c0480c79d59db858.jpg already downloaded
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F32%252F8632dae13c7098fea2969de7ee4a531f%252Fpa%252FCF49225_7a9475c386e6c316783e03054533417c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_7a9475c386e6c316783e03054533417c.jpg already downloaded
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F32%252F8632dae13c7098fea2969de7ee4a531f%252Fpa%252FCF49225_a8d9e807520902057d73da610d37f77a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_a8d9e807520902057d73da610d37f77a.jpg already downloaded
2026-03-30 08:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 60051082-e946-526f-be81-a3c9ee477803, identifier: CF49225
2026-03-30 08:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5fc57bf8-53fc-549b-a1f6-e328629ba799 with identifier: PY47802
2026-03-30 08:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5fc57bf8-53fc-549b-a1f6-e328629ba799 with identifier: PY47802
2026-03-30 08:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5fc57bf8-53fc-549b-a1f6-e328629ba799 with identifier: PY47802 to the API
2026-03-30 08:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:50:17Z',
 'fuel_type': 'petrol',
 'id': '5fc57bf8-53fc-549b-a1f6-e328629ba799',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY47802',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 91606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-04',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2010}
2026-03-30 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY47802%27 HTTP/1.1" 200 None
2026-03-30 08:30:49 [auto1.be] INFO: Saving data for PY47802: {'auction_closing_time': 1774972217.0, 'created_time': 1773236742.198009, 'last_price_update_time': 1774859449.657819}
2026-03-30 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY47802') HTTP/1.1" 204 0
2026-03-30 08:30:49 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-30 08:30:49 [auto1.be] INFO: Found listing with ID: VP95014
2026-03-30 08:30:49 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-30 08:30:49 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-30 08:30:49 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-30 08:30:49 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-30 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL86303%27 HTTP/1.1" 200 None
2026-03-30 08:30:49 [auto1.be] INFO: Scrape type for VL86303: 2
2026-03-30 08:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eec0fd90-44ee-5a2f-853d-e1d42e072335 with identifier: VL86303
2026-03-30 08:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eec0fd90-44ee-5a2f-853d-e1d42e072335 with scrape type 2
2026-03-30 08:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eec0fd90-44ee-5a2f-853d-e1d42e072335 with scrape type 2
2026-03-30 08:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eec0fd90-44ee-5a2f-853d-e1d42e072335, identifier: VL86303
2026-03-30 08:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 60051082-e946-526f-be81-a3c9ee477803 with identifier: CF49225
2026-03-30 08:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 60051082-e946-526f-be81-a3c9ee477803 with identifier: CF49225
2026-03-30 08:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 60051082-e946-526f-be81-a3c9ee477803 with identifier: CF49225 to the API
2026-03-30 08:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CF49225>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 182,
 'expiration_date': '2026-03-31T15:20:06Z',
 'fuel_type': 'petrol',
 'id': '60051082-e946-526f-be81-a3c9ee477803',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF49225',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 124160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_356cf552aba3aaa86dadc550df1a0fd1.jpg',
                'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_4883d4bafdc51664ad1e9b79e164e908.jpg',
                'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_14bd3576152450ddb760eb76fef45ad8.jpg',
                'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_33b8bdd162c25fb36eb3693594ef58e7.jpg',
                'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_32ba233ef8392e86edd1776341c1ea41.jpg',
                'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_39a93cf05f946721effeb84b6b036da4.jpg',
                'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_0fa653fc50a34b75c2e223c7c24f6e01.jpg',
                'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_7f4c3e41a07e36c2c0480c79d59db858.jpg',
                'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_7a9475c386e6c316783e03054533417c.jpg',
                'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_a8d9e807520902057d73da610d37f77a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60051082-e946-526f-be81-a3c9ee477803/60051082-e946-526f-be81-a3c9ee477803_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624980,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_356cf552aba3aaa86dadc550df1a0fd1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60051082-e946-526f-be81-a3c9ee477803/60051082-e946-526f-be81-a3c9ee477803_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2720793,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_4883d4bafdc51664ad1e9b79e164e908.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60051082-e946-526f-be81-a3c9ee477803/60051082-e946-526f-be81-a3c9ee477803_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479268,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_14bd3576152450ddb760eb76fef45ad8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60051082-e946-526f-be81-a3c9ee477803/60051082-e946-526f-be81-a3c9ee477803_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2617853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_33b8bdd162c25fb36eb3693594ef58e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60051082-e946-526f-be81-a3c9ee477803/60051082-e946-526f-be81-a3c9ee477803_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2512681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_32ba233ef8392e86edd1776341c1ea41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60051082-e946-526f-be81-a3c9ee477803/60051082-e946-526f-be81-a3c9ee477803_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_39a93cf05f946721effeb84b6b036da4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60051082-e946-526f-be81-a3c9ee477803/60051082-e946-526f-be81-a3c9ee477803_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2641804,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_0fa653fc50a34b75c2e223c7c24f6e01.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60051082-e946-526f-be81-a3c9ee477803/60051082-e946-526f-be81-a3c9ee477803_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_7f4c3e41a07e36c2c0480c79d59db858.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60051082-e946-526f-be81-a3c9ee477803/60051082-e946-526f-be81-a3c9ee477803_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2625404,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_7a9475c386e6c316783e03054533417c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60051082-e946-526f-be81-a3c9ee477803/60051082-e946-526f-be81-a3c9ee477803_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2941843,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/32/8632dae13c7098fea2969de7ee4a531f/pa/CF49225_a8d9e807520902057d73da610d37f77a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Individual',
 'transmission': 'automatic',
 'trim': 'Individual',
 'year': 2016}
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF49225%27 HTTP/1.1" 200 None
2026-03-30 08:30:50 [auto1.be] INFO: Saving data for CF49225: {'created_time': 1774859450.345826, 'last_price_update_time': 1774859450.345837, 'auction_closing_time': 1774970406.0}
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CF49225') HTTP/1.1" 204 0
2026-03-30 08:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c955add0>
2026-03-30 08:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_fa4cc4a4c53c47b328986600681564dc.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_fa4cc4a4c53c47b328986600681564dc.jpg saved to cache
2026-03-30 08:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa
2026-03-30 08:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_fae1bad0d902844a303cbc16aa8c2756.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:50 [auto1.be] INFO: Found listing with ID: RD37587
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD37587%27 HTTP/1.1" 200 None
2026-03-30 08:30:50 [auto1.be] INFO: Scrape type for RD37587: 2
2026-03-30 08:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9459c987-8987-5c75-af7e-04d33f12b612 with identifier: RD37587
2026-03-30 08:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9459c987-8987-5c75-af7e-04d33f12b612 with scrape type 2
2026-03-30 08:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9459c987-8987-5c75-af7e-04d33f12b612 with scrape type 2
2026-03-30 08:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9459c987-8987-5c75-af7e-04d33f12b612, identifier: RD37587
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_4d41d94366888ad9f15b6a029eff5654.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_4d41d94366888ad9f15b6a029eff5654.jpg not downloaded yet
2026-03-30 08:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eec0fd90-44ee-5a2f-853d-e1d42e072335 with identifier: VL86303
2026-03-30 08:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eec0fd90-44ee-5a2f-853d-e1d42e072335 with identifier: VL86303
2026-03-30 08:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eec0fd90-44ee-5a2f-853d-e1d42e072335 with identifier: VL86303 to the API
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:50:55Z',
 'fuel_type': 'diesel',
 'id': 'eec0fd90-44ee-5a2f-853d-e1d42e072335',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL86303',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 207610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-24',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL86303%27 HTTP/1.1" 200 None
2026-03-30 08:30:51 [auto1.be] INFO: Saving data for VL86303: {'auction_closing_time': 1774972255.0, 'created_time': 1773137544.01723, 'last_price_update_time': 1774859451.082973}
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VL86303') HTTP/1.1" 204 0
2026-03-30 08:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_af4d7ae09aba0438f13f91555637190d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9459c987-8987-5c75-af7e-04d33f12b612 with identifier: RD37587
2026-03-30 08:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9459c987-8987-5c75-af7e-04d33f12b612 with identifier: RD37587
2026-03-30 08:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9459c987-8987-5c75-af7e-04d33f12b612 with identifier: RD37587 to the API
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:54:13Z',
 'fuel_type': 'petrol',
 'id': '9459c987-8987-5c75-af7e-04d33f12b612',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD37587',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 101192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD37587%27 HTTP/1.1" 200 None
2026-03-30 08:30:51 [auto1.be] INFO: Saving data for RD37587: {'auction_closing_time': 1774972453.0, 'created_time': 1774297958.66168, 'last_price_update_time': 1774859451.486113}
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RD37587') HTTP/1.1" 204 0
2026-03-30 08:30:51 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-30 08:30:51 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY90857%27 HTTP/1.1" 200 None
2026-03-30 08:30:51 [auto1.be] INFO: Scrape type for DY90857: 2
2026-03-30 08:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd40123f-beeb-55c8-96fe-12ae2d68305e with identifier: DY90857
2026-03-30 08:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd40123f-beeb-55c8-96fe-12ae2d68305e with scrape type 2
2026-03-30 08:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd40123f-beeb-55c8-96fe-12ae2d68305e with scrape type 2
2026-03-30 08:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd40123f-beeb-55c8-96fe-12ae2d68305e, identifier: DY90857
2026-03-30 08:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6946a55a-bc5a-53be-967f-97023b11bd7e with identifier: EW88607
2026-03-30 08:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6946a55a-bc5a-53be-967f-97023b11bd7e with scrape type 1
2026-03-30 08:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6946a55a-bc5a-53be-967f-97023b11bd7e
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_0237cf35924c0e9240a780009b5ad7e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_0237cf35924c0e9240a780009b5ad7e1.jpg not downloaded yet
2026-03-30 08:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c955f310>
2026-03-30 08:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_1c3c4641ad00098c4b26b54983e88565.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_1c3c4641ad00098c4b26b54983e88565.jpg saved to cache
2026-03-30 08:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa
2026-03-30 08:30:51 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-30 08:30:51 [auto1.be] INFO: Found listing with ID: SG64560
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG64560%27 HTTP/1.1" 200 None
2026-03-30 08:30:51 [auto1.be] INFO: Scrape type for SG64560: 2
2026-03-30 08:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d81c367-d47d-5267-be38-a6e891a878ac with identifier: SG64560
2026-03-30 08:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d81c367-d47d-5267-be38-a6e891a878ac with scrape type 2
2026-03-30 08:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d81c367-d47d-5267-be38-a6e891a878ac with scrape type 2
2026-03-30 08:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1d81c367-d47d-5267-be38-a6e891a878ac, identifier: SG64560
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_849994725f56c2a1deca5774e97f6965.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_849994725f56c2a1deca5774e97f6965.jpg not downloaded yet
2026-03-30 08:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd40123f-beeb-55c8-96fe-12ae2d68305e with identifier: DY90857
2026-03-30 08:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd40123f-beeb-55c8-96fe-12ae2d68305e with identifier: DY90857
2026-03-30 08:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd40123f-beeb-55c8-96fe-12ae2d68305e with identifier: DY90857 to the API
2026-03-30 08:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:17:04Z',
 'fuel_type': 'diesel',
 'id': 'cd40123f-beeb-55c8-96fe-12ae2d68305e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY90857',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 219477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY90857%27 HTTP/1.1" 200 None
2026-03-30 08:30:52 [auto1.be] INFO: Saving data for DY90857: {'auction_closing_time': 1774970224.0, 'created_time': 1773135356.109271, 'last_price_update_time': 1774859452.176808}
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY90857') HTTP/1.1" 204 0
2026-03-30 08:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_61d5416295bb328c7a606190ae49d627.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1d81c367-d47d-5267-be38-a6e891a878ac with identifier: SG64560
2026-03-30 08:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1d81c367-d47d-5267-be38-a6e891a878ac with identifier: SG64560
2026-03-30 08:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1d81c367-d47d-5267-be38-a6e891a878ac with identifier: SG64560 to the API
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:55:07Z',
 'fuel_type': 'petrol',
 'id': '1d81c367-d47d-5267-be38-a6e891a878ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG64560',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 104621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-17',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG64560%27 HTTP/1.1" 200 None
2026-03-30 08:30:52 [auto1.be] INFO: Saving data for SG64560: {'auction_closing_time': 1774972507.0, 'created_time': 1773135808.317353, 'last_price_update_time': 1774859452.543564}
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SG64560') HTTP/1.1" 204 0
2026-03-30 08:30:52 [auto1.be] INFO: Found listing with ID: LB99980
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB99980%27 HTTP/1.1" 200 None
2026-03-30 08:30:52 [auto1.be] INFO: Scrape type for LB99980: 2
2026-03-30 08:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41693a05-4dc0-5306-8752-4a65c4202928 with identifier: LB99980
2026-03-30 08:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41693a05-4dc0-5306-8752-4a65c4202928 with scrape type 2
2026-03-30 08:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41693a05-4dc0-5306-8752-4a65c4202928 with scrape type 2
2026-03-30 08:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41693a05-4dc0-5306-8752-4a65c4202928, identifier: LB99980
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_5126fffadc3e6d4a4696e5670a44532a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_5126fffadc3e6d4a4696e5670a44532a.jpg not downloaded yet
2026-03-30 08:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7a6110>
2026-03-30 08:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_fae1bad0d902844a303cbc16aa8c2756.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_fae1bad0d902844a303cbc16aa8c2756.jpg saved to cache
2026-03-30 08:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa
2026-03-30 08:30:52 [auto1.be] INFO: Found listing with ID: XL28387
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL28387%27 HTTP/1.1" 200 None
2026-03-30 08:30:52 [auto1.be] INFO: Scrape type for XL28387: 2
2026-03-30 08:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73571103-01af-55c2-97bb-c1d96d50c250 with identifier: XL28387
2026-03-30 08:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73571103-01af-55c2-97bb-c1d96d50c250 with scrape type 2
2026-03-30 08:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73571103-01af-55c2-97bb-c1d96d50c250 with scrape type 2
2026-03-30 08:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73571103-01af-55c2-97bb-c1d96d50c250, identifier: XL28387
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_9b25264496b5b773a04e156387d2a7f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_9b25264496b5b773a04e156387d2a7f9.jpg not downloaded yet
2026-03-30 08:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41693a05-4dc0-5306-8752-4a65c4202928 with identifier: LB99980
2026-03-30 08:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41693a05-4dc0-5306-8752-4a65c4202928 with identifier: LB99980
2026-03-30 08:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41693a05-4dc0-5306-8752-4a65c4202928 with identifier: LB99980 to the API
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:37:58Z',
 'fuel_type': 'diesel',
 'id': '41693a05-4dc0-5306-8752-4a65c4202928',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB99980',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 68405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-20',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 300 L1 Trend',
 'transmission': 'manual',
 'trim': '300 L1 Trend',
 'year': 2022}
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB99980%27 HTTP/1.1" 200 None
2026-03-30 08:30:53 [auto1.be] INFO: Saving data for LB99980: {'auction_closing_time': 1774971478.0, 'created_time': 1774384255.878822, 'last_price_update_time': 1774859453.300808}
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LB99980') HTTP/1.1" 204 0
2026-03-30 08:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_f3b148875efb06da497cf353b14a7da6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73571103-01af-55c2-97bb-c1d96d50c250 with identifier: XL28387
2026-03-30 08:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73571103-01af-55c2-97bb-c1d96d50c250 with identifier: XL28387
2026-03-30 08:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73571103-01af-55c2-97bb-c1d96d50c250 with identifier: XL28387 to the API
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:13:14Z',
 'fuel_type': 'petrol',
 'id': '73571103-01af-55c2-97bb-c1d96d50c250',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL28387',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 219100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL28387%27 HTTP/1.1" 200 None
2026-03-30 08:30:53 [auto1.be] INFO: Saving data for XL28387: {'auction_closing_time': 1774969994.0, 'created_time': 1774470947.006735, 'last_price_update_time': 1774859453.665119}
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL28387') HTTP/1.1" 204 0
2026-03-30 08:30:53 [auto1.be] INFO: Found listing with ID: FH32822
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH32822%27 HTTP/1.1" 200 None
2026-03-30 08:30:53 [auto1.be] INFO: Scrape type for FH32822: 2
2026-03-30 08:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41f388a3-6f00-5acb-8849-1c08c088f157 with identifier: FH32822
2026-03-30 08:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41f388a3-6f00-5acb-8849-1c08c088f157 with scrape type 2
2026-03-30 08:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41f388a3-6f00-5acb-8849-1c08c088f157 with scrape type 2
2026-03-30 08:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41f388a3-6f00-5acb-8849-1c08c088f157, identifier: FH32822
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_530195a2b134c2aff2b56fde46c21e42.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_530195a2b134c2aff2b56fde46c21e42.jpg not downloaded yet
2026-03-30 08:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c94c3f10>
2026-03-30 08:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_af4d7ae09aba0438f13f91555637190d.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_af4d7ae09aba0438f13f91555637190d.jpg saved to cache
2026-03-30 08:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa
2026-03-30 08:30:53 [auto1.be] INFO: Found listing with ID: XZ87385
2026-03-30 08:30:53 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR41774%27 HTTP/1.1" 200 None
2026-03-30 08:30:53 [auto1.be] INFO: Scrape type for WR41774: 2
2026-03-30 08:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6 with identifier: WR41774
2026-03-30 08:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6 with scrape type 2
2026-03-30 08:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6 with scrape type 2
2026-03-30 08:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6, identifier: WR41774
2026-03-30 08:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41f388a3-6f00-5acb-8849-1c08c088f157 with identifier: FH32822
2026-03-30 08:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41f388a3-6f00-5acb-8849-1c08c088f157 with identifier: FH32822
2026-03-30 08:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41f388a3-6f00-5acb-8849-1c08c088f157 with identifier: FH32822 to the API
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:29:49Z',
 'fuel_type': 'diesel',
 'id': '41f388a3-6f00-5acb-8849-1c08c088f157',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH32822',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Jetta',
 'odometer': 260444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-16',
 'seller_name': None,
 'title': 'Volkswagen Jetta 1.9 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2005}
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH32822%27 HTTP/1.1" 200 None
2026-03-30 08:30:54 [auto1.be] INFO: Saving data for FH32822: {'auction_closing_time': 1774970989.0, 'created_time': 1774298141.247256, 'last_price_update_time': 1774859454.319802}
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FH32822') HTTP/1.1" 204 0
2026-03-30 08:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6cc970310>
2026-03-30 08:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_61d5416295bb328c7a606190ae49d627.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_61d5416295bb328c7a606190ae49d627.jpg saved to cache
2026-03-30 08:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa
2026-03-30 08:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6 with identifier: WR41774
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 08:30:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6 with identifier: WR41774
2026-03-30 08:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 91ac3e24-e74d-5bf0-9755-018ff5cb1ea6 with identifier: WR41774 to the API
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-31T15:47:03Z',
 'fuel_type': 'petrol',
 'id': '91ac3e24-e74d-5bf0-9755-018ff5cb1ea6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR41774',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 46213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-10',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR41774%27 HTTP/1.1" 200 None
2026-03-30 08:30:54 [auto1.be] INFO: Saving data for WR41774: {'auction_closing_time': 1774972023.0, 'created_time': 1773132634.93466, 'last_price_update_time': 1774859454.984705}
2026-03-30 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WR41774') HTTP/1.1" 204 0
2026-03-30 08:30:55 [auto1.be] INFO: Found listing with ID: GS30663
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS30663%27 HTTP/1.1" 200 None
2026-03-30 08:30:55 [auto1.be] INFO: Scrape type for GS30663: 1
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_3e0296ec37a2b8dc9d82a6066d0bade7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_3e0296ec37a2b8dc9d82a6066d0bade7.jpg not downloaded yet
2026-03-30 08:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD49334/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_0237cf35924c0e9240a780009b5ad7e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_4d41d94366888ad9f15b6a029eff5654.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:55 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT02833%27 HTTP/1.1" 200 None
2026-03-30 08:30:55 [auto1.be] INFO: Scrape type for DT02833: 2
2026-03-30 08:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 193bba3a-4ff0-5341-acd6-c6a5d5391ca7 with identifier: DT02833
2026-03-30 08:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 193bba3a-4ff0-5341-acd6-c6a5d5391ca7 with scrape type 2
2026-03-30 08:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 193bba3a-4ff0-5341-acd6-c6a5d5391ca7 with scrape type 2
2026-03-30 08:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 193bba3a-4ff0-5341-acd6-c6a5d5391ca7, identifier: DT02833
2026-03-30 08:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c945d690>
2026-03-30 08:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_f3b148875efb06da497cf353b14a7da6.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_f3b148875efb06da497cf353b14a7da6.jpg saved to cache
2026-03-30 08:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa
2026-03-30 08:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_849994725f56c2a1deca5774e97f6965.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 193bba3a-4ff0-5341-acd6-c6a5d5391ca7 with identifier: DT02833
2026-03-30 08:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 193bba3a-4ff0-5341-acd6-c6a5d5391ca7 with identifier: DT02833
2026-03-30 08:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 193bba3a-4ff0-5341-acd6-c6a5d5391ca7 with identifier: DT02833 to the API
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:57:25Z',
 'fuel_type': 'petrol',
 'id': '193bba3a-4ff0-5341-acd6-c6a5d5391ca7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT02833',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 264797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-26',
 'seller_name': None,
 'title': 'BMW 3er 328i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT02833%27 HTTP/1.1" 200 None
2026-03-30 08:30:55 [auto1.be] INFO: Saving data for DT02833: {'auction_closing_time': 1774972645.0, 'created_time': 1773238412.724078, 'last_price_update_time': 1774859455.589082}
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DT02833') HTTP/1.1" 204 0
2026-03-30 08:30:55 [auto1.be] INFO: Found listing with ID: YE48599
2026-03-30 08:30:55 [auto1.be] INFO: Found listing with ID: XY44449
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY44449%27 HTTP/1.1" 200 None
2026-03-30 08:30:55 [auto1.be] INFO: Scrape type for XY44449: 1
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_98c6d49afacdd91a8fe7ae689d0c20d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_98c6d49afacdd91a8fe7ae689d0c20d0.jpg not downloaded yet
2026-03-30 08:30:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:55 [auto1.be] INFO: Found listing with ID: ZV23610
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV23610%27 HTTP/1.1" 200 None
2026-03-30 08:30:55 [auto1.be] INFO: Scrape type for ZV23610: 1
2026-03-30 08:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX41368/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_9b25264496b5b773a04e156387d2a7f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:55 [auto1.be] INFO: Found listing with ID: JT22008
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT22008%27 HTTP/1.1" 200 None
2026-03-30 08:30:55 [auto1.be] INFO: Scrape type for JT22008: 2
2026-03-30 08:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 806e153a-5441-596e-a179-71ea93fba2f4 with identifier: JT22008
2026-03-30 08:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 806e153a-5441-596e-a179-71ea93fba2f4 with scrape type 2
2026-03-30 08:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 806e153a-5441-596e-a179-71ea93fba2f4 with scrape type 2
2026-03-30 08:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 806e153a-5441-596e-a179-71ea93fba2f4, identifier: JT22008
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_481d15992cbb8ef1614d4a086fa475c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_481d15992cbb8ef1614d4a086fa475c7.jpg not downloaded yet
2026-03-30 08:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c956aed0>
2026-03-30 08:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_0237cf35924c0e9240a780009b5ad7e1.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_0237cf35924c0e9240a780009b5ad7e1.jpg saved to cache
2026-03-30 08:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6946a55a-bc5a-53be-967f-97023b11bd7e
2026-03-30 08:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca787dd0>
2026-03-30 08:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_4d41d94366888ad9f15b6a029eff5654.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_4d41d94366888ad9f15b6a029eff5654.jpg saved to cache
2026-03-30 08:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa
2026-03-30 08:30:55 [auto1.be] INFO: Found listing with ID: FH19686
2026-03-30 08:30:55 [auto1.be] INFO: Found listing with ID: JT53562
2026-03-30 08:30:55 [auto1.be] INFO: Found listing with ID: NH91226
2026-03-30 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH91226%27 HTTP/1.1" 200 None
2026-03-30 08:30:56 [auto1.be] INFO: Scrape type for NH91226: 1
2026-03-30 08:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 806e153a-5441-596e-a179-71ea93fba2f4 with identifier: JT22008
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 08:30:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 806e153a-5441-596e-a179-71ea93fba2f4 with identifier: JT22008
2026-03-30 08:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 806e153a-5441-596e-a179-71ea93fba2f4 with identifier: JT22008 to the API
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:57:26Z',
 'fuel_type': 'petrol',
 'id': '806e153a-5441-596e-a179-71ea93fba2f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT22008',
 'listing': 'auction',
 'make': 'Daewoo',
 'model': 'Tacuma',
 'odometer': 215597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-25',
 'seller_name': None,
 'title': 'Daewoo Tacuma 1.6 SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2004}
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT22008%27 HTTP/1.1" 200 None
2026-03-30 08:30:56 [auto1.be] INFO: Saving data for JT22008: {'auction_closing_time': 1774972646.0, 'created_time': 1774384463.030628, 'last_price_update_time': 1774859456.774974}
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JT22008') HTTP/1.1" 204 0
2026-03-30 08:30:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca6d1a90>
2026-03-30 08:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_849994725f56c2a1deca5774e97f6965.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_849994725f56c2a1deca5774e97f6965.jpg saved to cache
2026-03-30 08:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa
2026-03-30 08:30:56 [auto1.be] INFO: Found listing with ID: KN48892
2026-03-30 08:30:56 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ61714%27 HTTP/1.1" 200 None
2026-03-30 08:30:56 [auto1.be] INFO: Scrape type for HJ61714: 2
2026-03-30 08:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6ee21ef-849b-5011-995d-887acf6eacc2 with identifier: HJ61714
2026-03-30 08:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6ee21ef-849b-5011-995d-887acf6eacc2 with scrape type 2
2026-03-30 08:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6ee21ef-849b-5011-995d-887acf6eacc2 with scrape type 2
2026-03-30 08:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c6ee21ef-849b-5011-995d-887acf6eacc2, identifier: HJ61714
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_cf6a5e0fa128166e3cd27d665928b9c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_cf6a5e0fa128166e3cd27d665928b9c3.jpg not downloaded yet
2026-03-30 08:30:56 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-30 08:30:56 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-30 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY23736%27 HTTP/1.1" 200 None
2026-03-30 08:30:57 [auto1.be] INFO: Scrape type for ZY23736: 2
2026-03-30 08:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de252dbf-0eab-5762-be54-0ccca4a71df7 with identifier: ZY23736
2026-03-30 08:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de252dbf-0eab-5762-be54-0ccca4a71df7 with scrape type 2
2026-03-30 08:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de252dbf-0eab-5762-be54-0ccca4a71df7 with scrape type 2
2026-03-30 08:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: de252dbf-0eab-5762-be54-0ccca4a71df7, identifier: ZY23736
2026-03-30 08:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c6ee21ef-849b-5011-995d-887acf6eacc2 with identifier: HJ61714
2026-03-30 08:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c6ee21ef-849b-5011-995d-887acf6eacc2 with identifier: HJ61714
2026-03-30 08:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c6ee21ef-849b-5011-995d-887acf6eacc2 with identifier: HJ61714 to the API
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:46:37Z',
 'fuel_type': 'petrol',
 'id': 'c6ee21ef-849b-5011-995d-887acf6eacc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ61714',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 191306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-08',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI Carat',
 'transmission': 'automatic',
 'trim': 'Carat',
 'year': 2009}
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ61714%27 HTTP/1.1" 200 None
2026-03-30 08:30:57 [auto1.be] INFO: Saving data for HJ61714: {'auction_closing_time': 1774971997.0, 'created_time': 1773693937.188168, 'last_price_update_time': 1774859457.426369}
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ61714') HTTP/1.1" 204 0
2026-03-30 08:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca769150>
2026-03-30 08:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F1b%252F4f1bb5d37a99044b1b00e757308c9453%252Fpa%252FJH90909_9b25264496b5b773a04e156387d2a7f9.jpg') HTTP/1.1" 204 0
2026-03-30 08:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_9b25264496b5b773a04e156387d2a7f9.jpg saved to cache
2026-03-30 08:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa
2026-03-30 08:30:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6db47c40-0b2b-54fa-99d0-89c6853bf2fa, skipping ID generation
2026-03-30 08:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa with scrape type 1
2026-03-30 08:30:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6db47c40-0b2b-54fa-99d0-89c6853bf2fa sending to next pipeline
2026-03-30 08:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6db47c40-0b2b-54fa-99d0-89c6853bf2fa, identifier: JH90909
2026-03-30 08:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: de252dbf-0eab-5762-be54-0ccca4a71df7 with identifier: ZY23736
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 08:30:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: de252dbf-0eab-5762-be54-0ccca4a71df7 with identifier: ZY23736
2026-03-30 08:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: de252dbf-0eab-5762-be54-0ccca4a71df7 with identifier: ZY23736 to the API
2026-03-30 08:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:07:40Z',
 'fuel_type': 'diesel',
 'id': 'de252dbf-0eab-5762-be54-0ccca4a71df7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY23736',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 105897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-26',
 'seller_name': None,
 'title': 'Fiat 500L 1.6 JTDM Trekking',
 'transmission': 'manual',
 'trim': 'Trekking',
 'year': 2014}
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY23736%27 HTTP/1.1" 200 None
2026-03-30 08:30:58 [auto1.be] INFO: Saving data for ZY23736: {'auction_closing_time': 1774969660.0, 'created_time': 1773136813.775461, 'last_price_update_time': 1774859458.153489}
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY23736') HTTP/1.1" 204 0
2026-03-30 08:30:58 [auto1.be] INFO: Found listing with ID: EM93050
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM93050%27 HTTP/1.1" 200 None
2026-03-30 08:30:58 [auto1.be] INFO: Scrape type for EM93050: 2
2026-03-30 08:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 300cd3d4-6878-5b28-976e-8c441d7c0b24 with identifier: EM93050
2026-03-30 08:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 300cd3d4-6878-5b28-976e-8c441d7c0b24 with scrape type 2
2026-03-30 08:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 300cd3d4-6878-5b28-976e-8c441d7c0b24 with scrape type 2
2026-03-30 08:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 300cd3d4-6878-5b28-976e-8c441d7c0b24, identifier: EM93050
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_3cb4ba6d584e27477898ae72ed18df04.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_3cb4ba6d584e27477898ae72ed18df04.jpg not downloaded yet
2026-03-30 08:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU28808/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG70291> (referer: https://www.auto1.com/v1/car-details-view/SG70291/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6db47c40-0b2b-54fa-99d0-89c6853bf2fa with identifier: JH90909
2026-03-30 08:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6db47c40-0b2b-54fa-99d0-89c6853bf2fa with identifier: JH90909
2026-03-30 08:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6db47c40-0b2b-54fa-99d0-89c6853bf2fa with identifier: JH90909 to the API
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_9b25264496b5b773a04e156387d2a7f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:57:26Z',
 'fuel_type': 'diesel',
 'id': '6db47c40-0b2b-54fa-99d0-89c6853bf2fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH90909',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 83790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_35a4547f22efbbf9880ca05a6d314c8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_fa4cc4a4c53c47b328986600681564dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_1c3c4641ad00098c4b26b54983e88565.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_fae1bad0d902844a303cbc16aa8c2756.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_af4d7ae09aba0438f13f91555637190d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_61d5416295bb328c7a606190ae49d627.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_f3b148875efb06da497cf353b14a7da6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_4d41d94366888ad9f15b6a029eff5654.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_849994725f56c2a1deca5774e97f6965.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db47c40-0b2b-54fa-99d0-89c6853bf2fa/6db47c40-0b2b-54fa-99d0-89c6853bf2fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/1b/4f1bb5d37a99044b1b00e757308c9453/pa/JH90909_9b25264496b5b773a04e156387d2a7f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2017}
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH90909%27 HTTP/1.1" 200 None
2026-03-30 08:30:58 [auto1.be] INFO: Saving data for JH90909: {'created_time': 1774859458.724254, 'last_price_update_time': 1774859458.724266, 'auction_closing_time': 1774972646.0}
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JH90909') HTTP/1.1" 204 0
2026-03-30 08:30:58 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-30 08:30:58 [auto1.be] INFO: Found listing with ID: LC68044
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC68044%27 HTTP/1.1" 200 None
2026-03-30 08:30:58 [auto1.be] INFO: Scrape type for LC68044: 2
2026-03-30 08:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62303b1c-be5b-538e-8540-5fd765710f75 with identifier: LC68044
2026-03-30 08:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62303b1c-be5b-538e-8540-5fd765710f75 with scrape type 2
2026-03-30 08:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62303b1c-be5b-538e-8540-5fd765710f75 with scrape type 2
2026-03-30 08:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 62303b1c-be5b-538e-8540-5fd765710f75, identifier: LC68044
2026-03-30 08:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 300cd3d4-6878-5b28-976e-8c441d7c0b24 with identifier: EM93050
2026-03-30 08:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 300cd3d4-6878-5b28-976e-8c441d7c0b24 with identifier: EM93050
2026-03-30 08:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 300cd3d4-6878-5b28-976e-8c441d7c0b24 with identifier: EM93050 to the API
2026-03-30 08:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:28:43Z',
 'fuel_type': 'diesel',
 'id': '300cd3d4-6878-5b28-976e-8c441d7c0b24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM93050',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 190830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-11',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d lang BlueTEC Edition',
 'transmission': 'automatic',
 'trim': 'lang BlueTEC Edition',
 'year': 2016}
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM93050%27 HTTP/1.1" 200 None
2026-03-30 08:30:59 [auto1.be] INFO: Saving data for EM93050: {'auction_closing_time': 1774970923.0, 'created_time': 1773138046.325528, 'last_price_update_time': 1774859459.268011}
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EM93050') HTTP/1.1" 204 0
2026-03-30 08:30:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU38310> (referer: https://www.auto1.com/v1/car-details-view/EU38310/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL96046> (referer: https://www.auto1.com/v1/car-details-view/NL96046/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:30:59 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1492 | hits on page: 40
2026-03-30 08:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_98c6d49afacdd91a8fe7ae689d0c20d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 62303b1c-be5b-538e-8540-5fd765710f75 with identifier: LC68044
2026-03-30 08:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 62303b1c-be5b-538e-8540-5fd765710f75 with identifier: LC68044
2026-03-30 08:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 62303b1c-be5b-538e-8540-5fd765710f75 with identifier: LC68044 to the API
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:29:46Z',
 'fuel_type': 'diesel',
 'id': '62303b1c-be5b-538e-8540-5fd765710f75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC68044',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 154898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-28',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 CDTI DPF Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Edition ecoFlex',
 'year': 2017}
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC68044%27 HTTP/1.1" 200 None
2026-03-30 08:30:59 [auto1.be] INFO: Saving data for LC68044: {'auction_closing_time': 1774970986.0, 'created_time': 1773133878.049553, 'last_price_update_time': 1774859459.632939}
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LC68044') HTTP/1.1" 204 0
2026-03-30 08:30:59 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-30 08:30:59 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA19213%27 HTTP/1.1" 200 None
2026-03-30 08:30:59 [auto1.be] INFO: Scrape type for FA19213: 2
2026-03-30 08:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93b6ac1e-3cc9-58eb-a262-f9485df11bb8 with identifier: FA19213
2026-03-30 08:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93b6ac1e-3cc9-58eb-a262-f9485df11bb8 with scrape type 2
2026-03-30 08:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93b6ac1e-3cc9-58eb-a262-f9485df11bb8 with scrape type 2
2026-03-30 08:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 93b6ac1e-3cc9-58eb-a262-f9485df11bb8, identifier: FA19213
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_f6af858219ef35ae0a0b31b2836c7561.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_f6af858219ef35ae0a0b31b2836c7561.jpg not downloaded yet
2026-03-30 08:30:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:30:59 [auto1.be] INFO: Found listing with ID: FM77705
2026-03-30 08:30:59 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14526%27 HTTP/1.1" 200 None
2026-03-30 08:30:59 [auto1.be] INFO: Scrape type for ZH14526: 2
2026-03-30 08:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bed99c10-7331-5534-8234-f47d130c40f1 with identifier: ZH14526
2026-03-30 08:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bed99c10-7331-5534-8234-f47d130c40f1 with scrape type 2
2026-03-30 08:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bed99c10-7331-5534-8234-f47d130c40f1 with scrape type 2
2026-03-30 08:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bed99c10-7331-5534-8234-f47d130c40f1, identifier: ZH14526
2026-03-30 08:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 93b6ac1e-3cc9-58eb-a262-f9485df11bb8 with identifier: FA19213
2026-03-30 08:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 93b6ac1e-3cc9-58eb-a262-f9485df11bb8 with identifier: FA19213
2026-03-30 08:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 93b6ac1e-3cc9-58eb-a262-f9485df11bb8 with identifier: FA19213 to the API
2026-03-30 08:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:47:26Z',
 'fuel_type': 'diesel',
 'id': '93b6ac1e-3cc9-58eb-a262-f9485df11bb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA19213',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 222099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-31',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
 'transmission': 'manual',
 'trim': 'Kinetic 2WD',
 'year': 2015}
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA19213%27 HTTP/1.1" 200 None
2026-03-30 08:31:00 [auto1.be] INFO: Saving data for FA19213: {'auction_closing_time': 1774972046.0, 'created_time': 1773301680.922963, 'last_price_update_time': 1774859460.243602}
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA19213') HTTP/1.1" 204 0
2026-03-30 08:31:00 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-30 08:31:00 [auto1.be] INFO: Found listing with ID: FV38279
2026-03-30 08:31:00 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-30 08:31:00 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-30 08:31:00 [auto1.be] INFO: Found listing with ID: CY95631
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY95631%27 HTTP/1.1" 200 None
2026-03-30 08:31:00 [auto1.be] INFO: Scrape type for CY95631: 2
2026-03-30 08:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e3f8d20-cfde-540a-8f9e-fff0f98f8bd7 with identifier: CY95631
2026-03-30 08:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e3f8d20-cfde-540a-8f9e-fff0f98f8bd7 with scrape type 2
2026-03-30 08:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e3f8d20-cfde-540a-8f9e-fff0f98f8bd7 with scrape type 2
2026-03-30 08:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5e3f8d20-cfde-540a-8f9e-fff0f98f8bd7, identifier: CY95631
2026-03-30 08:31:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5126268-377e-5aa3-8a2b-8fe04a6d2e3f with identifier: SG70291
2026-03-30 08:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5126268-377e-5aa3-8a2b-8fe04a6d2e3f with scrape type 1
2026-03-30 08:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5126268-377e-5aa3-8a2b-8fe04a6d2e3f
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9a%252F589a556f03bac1ce14b5a75d9da069b1%252Fpa%252FSG70291_a2c37ca419a0666b51e2439a653a3887.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_a2c37ca419a0666b51e2439a653a3887.jpg already downloaded
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9a%252F589a556f03bac1ce14b5a75d9da069b1%252Fpa%252FSG70291_23469a1e3fc0ae61abb6e786e5c37ea0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_23469a1e3fc0ae61abb6e786e5c37ea0.jpg already downloaded
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9a%252F589a556f03bac1ce14b5a75d9da069b1%252Fpa%252FSG70291_069054602003bb213be44e5f9ea7d021.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_069054602003bb213be44e5f9ea7d021.jpg already downloaded
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9a%252F589a556f03bac1ce14b5a75d9da069b1%252Fpa%252FSG70291_45b80b5b2e8ebc225a3c78292807f771.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_45b80b5b2e8ebc225a3c78292807f771.jpg already downloaded
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9a%252F589a556f03bac1ce14b5a75d9da069b1%252Fpa%252FSG70291_a3de5dde727458296a9832b23b5752df.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_a3de5dde727458296a9832b23b5752df.jpg already downloaded
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9a%252F589a556f03bac1ce14b5a75d9da069b1%252Fpa%252FSG70291_9e894eb1b552e165b5a4a40d28355031.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_9e894eb1b552e165b5a4a40d28355031.jpg already downloaded
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9a%252F589a556f03bac1ce14b5a75d9da069b1%252Fpa%252FSG70291_ecb5704aed4622448e093e48bc48337f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_ecb5704aed4622448e093e48bc48337f.jpg already downloaded
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9a%252F589a556f03bac1ce14b5a75d9da069b1%252Fpa%252FSG70291_e9b0a01ec9401626994f0ffc7e7d0e39.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_e9b0a01ec9401626994f0ffc7e7d0e39.jpg already downloaded
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9a%252F589a556f03bac1ce14b5a75d9da069b1%252Fpa%252FSG70291_04018bcda4c788f23857eade0371c17a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_04018bcda4c788f23857eade0371c17a.jpg already downloaded
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F9a%252F589a556f03bac1ce14b5a75d9da069b1%252Fpa%252FSG70291_338bdf7b64bac96a9ab4f617a08f7aae.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_338bdf7b64bac96a9ab4f617a08f7aae.jpg already downloaded
2026-03-30 08:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b5126268-377e-5aa3-8a2b-8fe04a6d2e3f, identifier: SG70291
2026-03-30 08:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_481d15992cbb8ef1614d4a086fa475c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bed99c10-7331-5534-8234-f47d130c40f1 with identifier: ZH14526
2026-03-30 08:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bed99c10-7331-5534-8234-f47d130c40f1 with identifier: ZH14526
2026-03-30 08:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bed99c10-7331-5534-8234-f47d130c40f1 with identifier: ZH14526 to the API
2026-03-30 08:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:26:02Z',
 'fuel_type': 'petrol',
 'id': 'bed99c10-7331-5534-8234-f47d130c40f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH14526',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 113735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-03',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.2 TSI Trendline BlueMotion Tech.',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech.',
 'year': 2013}
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14526%27 HTTP/1.1" 200 None
2026-03-30 08:31:01 [auto1.be] INFO: Saving data for ZH14526: {'auction_closing_time': 1774970762.0, 'created_time': 1773301782.319062, 'last_price_update_time': 1774859461.162364}
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZH14526') HTTP/1.1" 204 0
2026-03-30 08:31:01 [auto1.be] INFO: Found listing with ID: GC80115
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC80115%27 HTTP/1.1" 200 None
2026-03-30 08:31:01 [auto1.be] INFO: Scrape type for GC80115: 1
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_aa99eef8937559743401d2767ad2f932.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_aa99eef8937559743401d2767ad2f932.jpg not downloaded yet
2026-03-30 08:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5e3f8d20-cfde-540a-8f9e-fff0f98f8bd7 with identifier: CY95631
2026-03-30 08:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5e3f8d20-cfde-540a-8f9e-fff0f98f8bd7 with identifier: CY95631
2026-03-30 08:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5e3f8d20-cfde-540a-8f9e-fff0f98f8bd7 with identifier: CY95631 to the API
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-31T15:16:53Z',
 'fuel_type': 'petrol',
 'id': '5e3f8d20-cfde-540a-8f9e-fff0f98f8bd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY95631',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 12297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-20',
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY95631%27 HTTP/1.1" 200 None
2026-03-30 08:31:01 [auto1.be] INFO: Saving data for CY95631: {'auction_closing_time': 1774970213.0, 'created_time': 1774384277.548766, 'last_price_update_time': 1774859461.622943}
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CY95631') HTTP/1.1" 204 0
2026-03-30 08:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b5126268-377e-5aa3-8a2b-8fe04a6d2e3f with identifier: SG70291
2026-03-30 08:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b5126268-377e-5aa3-8a2b-8fe04a6d2e3f with identifier: SG70291
2026-03-30 08:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b5126268-377e-5aa3-8a2b-8fe04a6d2e3f with identifier: SG70291 to the API
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SG70291>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:36:56Z',
 'fuel_type': 'petrol',
 'id': 'b5126268-377e-5aa3-8a2b-8fe04a6d2e3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG70291',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_a2c37ca419a0666b51e2439a653a3887.jpg',
                'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_23469a1e3fc0ae61abb6e786e5c37ea0.jpg',
                'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_069054602003bb213be44e5f9ea7d021.jpg',
                'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_45b80b5b2e8ebc225a3c78292807f771.jpg',
                'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_a3de5dde727458296a9832b23b5752df.jpg',
                'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_9e894eb1b552e165b5a4a40d28355031.jpg',
                'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_ecb5704aed4622448e093e48bc48337f.jpg',
                'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_e9b0a01ec9401626994f0ffc7e7d0e39.jpg',
                'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_04018bcda4c788f23857eade0371c17a.jpg',
                'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_338bdf7b64bac96a9ab4f617a08f7aae.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5126268-377e-5aa3-8a2b-8fe04a6d2e3f/b5126268-377e-5aa3-8a2b-8fe04a6d2e3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2498095,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_a2c37ca419a0666b51e2439a653a3887.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5126268-377e-5aa3-8a2b-8fe04a6d2e3f/b5126268-377e-5aa3-8a2b-8fe04a6d2e3f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2503780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_23469a1e3fc0ae61abb6e786e5c37ea0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5126268-377e-5aa3-8a2b-8fe04a6d2e3f/b5126268-377e-5aa3-8a2b-8fe04a6d2e3f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2480463,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_069054602003bb213be44e5f9ea7d021.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5126268-377e-5aa3-8a2b-8fe04a6d2e3f/b5126268-377e-5aa3-8a2b-8fe04a6d2e3f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2625439,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_45b80b5b2e8ebc225a3c78292807f771.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5126268-377e-5aa3-8a2b-8fe04a6d2e3f/b5126268-377e-5aa3-8a2b-8fe04a6d2e3f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_a3de5dde727458296a9832b23b5752df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5126268-377e-5aa3-8a2b-8fe04a6d2e3f/b5126268-377e-5aa3-8a2b-8fe04a6d2e3f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_9e894eb1b552e165b5a4a40d28355031.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5126268-377e-5aa3-8a2b-8fe04a6d2e3f/b5126268-377e-5aa3-8a2b-8fe04a6d2e3f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2465749,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_ecb5704aed4622448e093e48bc48337f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5126268-377e-5aa3-8a2b-8fe04a6d2e3f/b5126268-377e-5aa3-8a2b-8fe04a6d2e3f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_e9b0a01ec9401626994f0ffc7e7d0e39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5126268-377e-5aa3-8a2b-8fe04a6d2e3f/b5126268-377e-5aa3-8a2b-8fe04a6d2e3f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_04018bcda4c788f23857eade0371c17a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5126268-377e-5aa3-8a2b-8fe04a6d2e3f/b5126268-377e-5aa3-8a2b-8fe04a6d2e3f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/9a/589a556f03bac1ce14b5a75d9da069b1/pa/SG70291_338bdf7b64bac96a9ab4f617a08f7aae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG70291%27 HTTP/1.1" 200 None
2026-03-30 08:31:01 [auto1.be] INFO: Saving data for SG70291: {'created_time': 1774859461.965057, 'last_price_update_time': 1774859461.965073, 'auction_closing_time': 1774971416.0}
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SG70291') HTTP/1.1" 204 0
2026-03-30 08:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_cf6a5e0fa128166e3cd27d665928b9c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:01 [auto1.be] INFO: Found listing with ID: UF38996
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF38996%27 HTTP/1.1" 200 None
2026-03-30 08:31:02 [auto1.be] INFO: Scrape type for UF38996: 1
2026-03-30 08:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 614f279e-472a-5f3c-b3e5-fb33b302e2b9 with identifier: EU38310
2026-03-30 08:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9 with scrape type 1
2026-03-30 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_97f48d78761ce67be94d1210e95a0af6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_97f48d78761ce67be94d1210e95a0af6.jpg not downloaded yet
2026-03-30 08:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0889cab-78aa-527c-b0dc-43821d2df211 with identifier: NL96046
2026-03-30 08:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0889cab-78aa-527c-b0dc-43821d2df211 with scrape type 1
2026-03-30 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0889cab-78aa-527c-b0dc-43821d2df211
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_a9163dfe20cebd81afab1cd1c69a5b87.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_a9163dfe20cebd81afab1cd1c69a5b87.jpg not downloaded yet
2026-03-30 08:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca6a7790>
2026-03-30 08:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_98c6d49afacdd91a8fe7ae689d0c20d0.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_98c6d49afacdd91a8fe7ae689d0c20d0.jpg saved to cache
2026-03-30 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6946a55a-bc5a-53be-967f-97023b11bd7e
2026-03-30 08:31:02 [auto1.be] INFO: Found listing with ID: GL14353
2026-03-30 08:31:02 [auto1.be] INFO: Found listing with ID: NH22682
2026-03-30 08:31:02 [auto1.be] INFO: Found listing with ID: WR44467
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR44467%27 HTTP/1.1" 200 None
2026-03-30 08:31:02 [auto1.be] INFO: Scrape type for WR44467: 2
2026-03-30 08:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21b9d5ab-fb25-5f54-b461-fc41cfdbdc93 with identifier: WR44467
2026-03-30 08:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21b9d5ab-fb25-5f54-b461-fc41cfdbdc93 with scrape type 2
2026-03-30 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21b9d5ab-fb25-5f54-b461-fc41cfdbdc93 with scrape type 2
2026-03-30 08:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 21b9d5ab-fb25-5f54-b461-fc41cfdbdc93, identifier: WR44467
2026-03-30 08:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS30663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 21b9d5ab-fb25-5f54-b461-fc41cfdbdc93 with identifier: WR44467
2026-03-30 08:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 21b9d5ab-fb25-5f54-b461-fc41cfdbdc93 with identifier: WR44467
2026-03-30 08:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 21b9d5ab-fb25-5f54-b461-fc41cfdbdc93 with identifier: WR44467 to the API
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:33:59Z',
 'fuel_type': 'diesel',
 'id': '21b9d5ab-fb25-5f54-b461-fc41cfdbdc93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR44467',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 344901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-28',
 'seller_name': None,
 'title': 'Renault Laguna 2.0 dCi Black Edition',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2011}
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR44467%27 HTTP/1.1" 200 None
2026-03-30 08:31:02 [auto1.be] INFO: Saving data for WR44467: {'auction_closing_time': 1774971239.0, 'created_time': 1773520460.929837, 'last_price_update_time': 1774859462.666437}
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WR44467') HTTP/1.1" 204 0
2026-03-30 08:31:02 [auto1.be] INFO: Found listing with ID: ED62480
2026-03-30 08:31:02 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ53898%27 HTTP/1.1" 200 None
2026-03-30 08:31:02 [auto1.be] INFO: Scrape type for TZ53898: 2
2026-03-30 08:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3803234f-1c01-59eb-9bc3-193cbc9b8acf with identifier: TZ53898
2026-03-30 08:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3803234f-1c01-59eb-9bc3-193cbc9b8acf with scrape type 2
2026-03-30 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3803234f-1c01-59eb-9bc3-193cbc9b8acf with scrape type 2
2026-03-30 08:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3803234f-1c01-59eb-9bc3-193cbc9b8acf, identifier: TZ53898
2026-03-30 08:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_42b2b42cf1bc0926bc60c802f3564d55.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_42b2b42cf1bc0926bc60c802f3564d55.jpg not downloaded yet
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_790bb7d0d1953560f68b2dbf03011313.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_790bb7d0d1953560f68b2dbf03011313.jpg not downloaded yet
2026-03-30 08:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY44449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c931e810>
2026-03-30 08:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_481d15992cbb8ef1614d4a086fa475c7.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_481d15992cbb8ef1614d4a086fa475c7.jpg saved to cache
2026-03-30 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6946a55a-bc5a-53be-967f-97023b11bd7e
2026-03-30 08:31:02 [auto1.be] INFO: Found listing with ID: FH77078
2026-03-30 08:31:02 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-30 08:31:02 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB29078%27 HTTP/1.1" 200 None
2026-03-30 08:31:02 [auto1.be] INFO: Scrape type for NB29078: 2
2026-03-30 08:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec796a85-1747-5cb2-9802-ba905635a0e2 with identifier: NB29078
2026-03-30 08:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec796a85-1747-5cb2-9802-ba905635a0e2 with scrape type 2
2026-03-30 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec796a85-1747-5cb2-9802-ba905635a0e2 with scrape type 2
2026-03-30 08:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec796a85-1747-5cb2-9802-ba905635a0e2, identifier: NB29078
2026-03-30 08:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3803234f-1c01-59eb-9bc3-193cbc9b8acf with identifier: TZ53898
2026-03-30 08:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3803234f-1c01-59eb-9bc3-193cbc9b8acf with identifier: TZ53898
2026-03-30 08:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3803234f-1c01-59eb-9bc3-193cbc9b8acf with identifier: TZ53898 to the API
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:16:25Z',
 'fuel_type': 'hybrid',
 'id': '3803234f-1c01-59eb-9bc3-193cbc9b8acf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ53898',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 46845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-04',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Cyan Edition',
 'transmission': 'automatic',
 'trim': 'Cyan Edition',
 'year': 2021}
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ53898%27 HTTP/1.1" 200 None
2026-03-30 08:31:03 [auto1.be] INFO: Saving data for TZ53898: {'auction_closing_time': 1774970185.0, 'created_time': 1774471229.412737, 'last_price_update_time': 1774859463.322619}
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TZ53898') HTTP/1.1" 204 0
2026-03-30 08:31:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7ff110>
2026-03-30 08:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_cf6a5e0fa128166e3cd27d665928b9c3.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_cf6a5e0fa128166e3cd27d665928b9c3.jpg saved to cache
2026-03-30 08:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6946a55a-bc5a-53be-967f-97023b11bd7e
2026-03-30 08:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec796a85-1747-5cb2-9802-ba905635a0e2 with identifier: NB29078
2026-03-30 08:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec796a85-1747-5cb2-9802-ba905635a0e2 with identifier: NB29078
2026-03-30 08:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec796a85-1747-5cb2-9802-ba905635a0e2 with identifier: NB29078 to the API
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:27:27Z',
 'fuel_type': 'petrol',
 'id': 'ec796a85-1747-5cb2-9802-ba905635a0e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB29078',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 18850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-06',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Stepway Extreme+',
 'transmission': 'manual',
 'trim': 'Stepway Extreme+',
 'year': 2023}
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB29078%27 HTTP/1.1" 200 None
2026-03-30 08:31:03 [auto1.be] INFO: Saving data for NB29078: {'auction_closing_time': 1774970847.0, 'created_time': 1774471283.095662, 'last_price_update_time': 1774859463.774152}
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB29078') HTTP/1.1" 204 0
2026-03-30 08:31:03 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-30 08:31:03 [auto1.be] INFO: Found listing with ID: MS84357
2026-03-30 08:31:03 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS28625%27 HTTP/1.1" 200 None
2026-03-30 08:31:03 [auto1.be] INFO: Scrape type for PS28625: 2
2026-03-30 08:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21965b2e-9e92-567d-9030-70078a563c71 with identifier: PS28625
2026-03-30 08:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21965b2e-9e92-567d-9030-70078a563c71 with scrape type 2
2026-03-30 08:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21965b2e-9e92-567d-9030-70078a563c71 with scrape type 2
2026-03-30 08:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 21965b2e-9e92-567d-9030-70078a563c71, identifier: PS28625
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_95072e045e440d484a6fd8a993b89db5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_95072e045e440d484a6fd8a993b89db5.jpg not downloaded yet
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_6376390b0655476b51df4bd1fa7f0961.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_6376390b0655476b51df4bd1fa7f0961.jpg not downloaded yet
2026-03-30 08:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_f6af858219ef35ae0a0b31b2836c7561.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:03 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD78607%27 HTTP/1.1" 200 None
2026-03-30 08:31:03 [auto1.be] INFO: Scrape type for PD78607: 2
2026-03-30 08:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4659c5f0-4955-5fd5-bfa2-1fd49ccff842 with identifier: PD78607
2026-03-30 08:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4659c5f0-4955-5fd5-bfa2-1fd49ccff842 with scrape type 2
2026-03-30 08:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4659c5f0-4955-5fd5-bfa2-1fd49ccff842 with scrape type 2
2026-03-30 08:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4659c5f0-4955-5fd5-bfa2-1fd49ccff842, identifier: PD78607
2026-03-30 08:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 21965b2e-9e92-567d-9030-70078a563c71 with identifier: PS28625
2026-03-30 08:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 21965b2e-9e92-567d-9030-70078a563c71 with identifier: PS28625
2026-03-30 08:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 21965b2e-9e92-567d-9030-70078a563c71 with identifier: PS28625 to the API
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:27:40Z',
 'fuel_type': 'diesel',
 'id': '21965b2e-9e92-567d-9030-70078a563c71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS28625',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 208983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CDI BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS28625%27 HTTP/1.1" 200 None
2026-03-30 08:31:04 [auto1.be] INFO: Saving data for PS28625: {'auction_closing_time': 1774970860.0, 'created_time': 1773135813.778567, 'last_price_update_time': 1774859464.382962}
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS28625') HTTP/1.1" 204 0
2026-03-30 08:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV23610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_aa99eef8937559743401d2767ad2f932.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4659c5f0-4955-5fd5-bfa2-1fd49ccff842 with identifier: PD78607
2026-03-30 08:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4659c5f0-4955-5fd5-bfa2-1fd49ccff842 with identifier: PD78607
2026-03-30 08:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4659c5f0-4955-5fd5-bfa2-1fd49ccff842 with identifier: PD78607 to the API
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:02:31Z',
 'fuel_type': 'petrol',
 'id': '4659c5f0-4955-5fd5-bfa2-1fd49ccff842',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD78607',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 155229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-21',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2010}
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD78607%27 HTTP/1.1" 200 None
2026-03-30 08:31:04 [auto1.be] INFO: Saving data for PD78607: {'auction_closing_time': 1774969351.0, 'created_time': 1773136307.054497, 'last_price_update_time': 1774859464.834404}
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PD78607') HTTP/1.1" 204 0
2026-03-30 08:31:04 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-30 08:31:04 [auto1.be] INFO: Found listing with ID: MD91238
2026-03-30 08:31:04 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-30 08:31:04 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-30 08:31:04 [auto1.be] INFO: Found listing with ID: XC26287
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC26287%27 HTTP/1.1" 200 None
2026-03-30 08:31:04 [auto1.be] INFO: Scrape type for XC26287: 2
2026-03-30 08:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59085604-2f06-528f-90d3-18875f67a3a4 with identifier: XC26287
2026-03-30 08:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59085604-2f06-528f-90d3-18875f67a3a4 with scrape type 2
2026-03-30 08:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59085604-2f06-528f-90d3-18875f67a3a4 with scrape type 2
2026-03-30 08:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 59085604-2f06-528f-90d3-18875f67a3a4, identifier: XC26287
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_f5a079359b645aa295ae0b5a1a3a4db3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_f5a079359b645aa295ae0b5a1a3a4db3.jpg not downloaded yet
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_6d789b0484d551b01924044e52cf53cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_6d789b0484d551b01924044e52cf53cc.jpg not downloaded yet
2026-03-30 08:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_a9163dfe20cebd81afab1cd1c69a5b87.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:05 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-30 08:31:05 [auto1.be] INFO: Found listing with ID: RH39924
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH39924%27 HTTP/1.1" 200 None
2026-03-30 08:31:05 [auto1.be] INFO: Scrape type for RH39924: 1
2026-03-30 08:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 59085604-2f06-528f-90d3-18875f67a3a4 with identifier: XC26287
2026-03-30 08:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 59085604-2f06-528f-90d3-18875f67a3a4 with identifier: XC26287
2026-03-30 08:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 59085604-2f06-528f-90d3-18875f67a3a4 with identifier: XC26287 to the API
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:18:08Z',
 'fuel_type': 'diesel',
 'id': '59085604-2f06-528f-90d3-18875f67a3a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC26287',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 87657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-01',
 'seller_name': None,
 'title': 'Ford Mondeo 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC26287%27 HTTP/1.1" 200 None
2026-03-30 08:31:05 [auto1.be] INFO: Saving data for XC26287: {'auction_closing_time': 1774970288.0, 'created_time': 1774384489.655188, 'last_price_update_time': 1774859465.338116}
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC26287') HTTP/1.1" 204 0
2026-03-30 08:31:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_97f48d78761ce67be94d1210e95a0af6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:05 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL40372%27 HTTP/1.1" 200 None
2026-03-30 08:31:05 [auto1.be] INFO: Scrape type for EL40372: 2
2026-03-30 08:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490f3616-d187-56ac-bcec-73dae31ca286 with identifier: EL40372
2026-03-30 08:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490f3616-d187-56ac-bcec-73dae31ca286 with scrape type 2
2026-03-30 08:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 490f3616-d187-56ac-bcec-73dae31ca286 with scrape type 2
2026-03-30 08:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 490f3616-d187-56ac-bcec-73dae31ca286, identifier: EL40372
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_e91bd2338ee4300652d3e9552e9110d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_e91bd2338ee4300652d3e9552e9110d8.jpg not downloaded yet
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_485ed94fa9c002c51a6f512d29a80339.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_485ed94fa9c002c51a6f512d29a80339.jpg not downloaded yet
2026-03-30 08:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD49334> (referer: https://www.auto1.com/v1/car-details-view/CD49334/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:05 [auto1.be] INFO: Found listing with ID: ML39304
2026-03-30 08:31:05 [auto1.be] INFO: Found listing with ID: EP05559
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP05559%27 HTTP/1.1" 200 None
2026-03-30 08:31:05 [auto1.be] INFO: Scrape type for EP05559: 2
2026-03-30 08:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42a044b2-5a25-5332-841b-9a033659e712 with identifier: EP05559
2026-03-30 08:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42a044b2-5a25-5332-841b-9a033659e712 with scrape type 2
2026-03-30 08:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42a044b2-5a25-5332-841b-9a033659e712 with scrape type 2
2026-03-30 08:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 42a044b2-5a25-5332-841b-9a033659e712, identifier: EP05559
2026-03-30 08:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 490f3616-d187-56ac-bcec-73dae31ca286 with identifier: EL40372
2026-03-30 08:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 490f3616-d187-56ac-bcec-73dae31ca286 with identifier: EL40372
2026-03-30 08:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 490f3616-d187-56ac-bcec-73dae31ca286 with identifier: EL40372 to the API
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:25:13Z',
 'fuel_type': 'petrol',
 'id': '490f3616-d187-56ac-bcec-73dae31ca286',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL40372',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 131135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-26',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 160 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL40372%27 HTTP/1.1" 200 None
2026-03-30 08:31:05 [auto1.be] INFO: Saving data for EL40372: {'auction_closing_time': 1774970713.0, 'created_time': 1774427440.547331, 'last_price_update_time': 1774859465.983388}
2026-03-30 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL40372') HTTP/1.1" 204 0
2026-03-30 08:31:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9603810>
2026-03-30 08:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_f6af858219ef35ae0a0b31b2836c7561.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_f6af858219ef35ae0a0b31b2836c7561.jpg saved to cache
2026-03-30 08:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6946a55a-bc5a-53be-967f-97023b11bd7e
2026-03-30 08:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c94b5dd0>
2026-03-30 08:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_aa99eef8937559743401d2767ad2f932.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_aa99eef8937559743401d2767ad2f932.jpg saved to cache
2026-03-30 08:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6946a55a-bc5a-53be-967f-97023b11bd7e
2026-03-30 08:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_790bb7d0d1953560f68b2dbf03011313.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 42a044b2-5a25-5332-841b-9a033659e712 with identifier: EP05559
2026-03-30 08:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 42a044b2-5a25-5332-841b-9a033659e712 with identifier: EP05559
2026-03-30 08:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 42a044b2-5a25-5332-841b-9a033659e712 with identifier: EP05559 to the API
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:33:44Z',
 'fuel_type': 'diesel',
 'id': '42a044b2-5a25-5332-841b-9a033659e712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP05559',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 142626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-20',
 'seller_name': None,
 'title': 'Opel Movano 2.3 CDTI HKa L2H2 3,3t',
 'transmission': 'automatic',
 'trim': 'HKa L2H2 3,3t',
 'year': 2013}
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP05559%27 HTTP/1.1" 200 None
2026-03-30 08:31:06 [auto1.be] INFO: Saving data for EP05559: {'auction_closing_time': 1774971224.0, 'created_time': 1774470999.219243, 'last_price_update_time': 1774859466.469655}
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP05559') HTTP/1.1" 204 0
2026-03-30 08:31:06 [auto1.be] INFO: Found listing with ID: YX69957
2026-03-30 08:31:06 [auto1.be] INFO: Found listing with ID: GS42296
2026-03-30 08:31:06 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM47313%27 HTTP/1.1" 200 None
2026-03-30 08:31:06 [auto1.be] INFO: Scrape type for PM47313: 2
2026-03-30 08:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d73cbb1a-d4c1-5aec-9ffb-5e37701d499a with identifier: PM47313
2026-03-30 08:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d73cbb1a-d4c1-5aec-9ffb-5e37701d499a with scrape type 2
2026-03-30 08:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d73cbb1a-d4c1-5aec-9ffb-5e37701d499a with scrape type 2
2026-03-30 08:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d73cbb1a-d4c1-5aec-9ffb-5e37701d499a, identifier: PM47313
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_64b4b2c759d8bfad4ac50fc742e4a576.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_64b4b2c759d8bfad4ac50fc742e4a576.jpg not downloaded yet
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_ecc2fcf5795058acba5a11b3ed59292c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_ecc2fcf5795058acba5a11b3ed59292c.jpg not downloaded yet
2026-03-30 08:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_6376390b0655476b51df4bd1fa7f0961.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_95072e045e440d484a6fd8a993b89db5.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:06 [auto1.be] INFO: Found listing with ID: XV08295
2026-03-30 08:31:06 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-30 08:31:06 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-30 08:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d73cbb1a-d4c1-5aec-9ffb-5e37701d499a with identifier: PM47313
2026-03-30 08:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d73cbb1a-d4c1-5aec-9ffb-5e37701d499a with identifier: PM47313
2026-03-30 08:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d73cbb1a-d4c1-5aec-9ffb-5e37701d499a with identifier: PM47313 to the API
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:53:33Z',
 'fuel_type': 'petrol',
 'id': 'd73cbb1a-d4c1-5aec-9ffb-5e37701d499a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM47313',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 60925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-28',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM47313%27 HTTP/1.1" 200 None
2026-03-30 08:31:06 [auto1.be] INFO: Saving data for PM47313: {'auction_closing_time': 1774972413.0, 'created_time': 1774471111.480827, 'last_price_update_time': 1774859466.956505}
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PM47313') HTTP/1.1" 204 0
2026-03-30 08:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c942cc90>
2026-03-30 08:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_a9163dfe20cebd81afab1cd1c69a5b87.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_a9163dfe20cebd81afab1cd1c69a5b87.jpg saved to cache
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0889cab-78aa-527c-b0dc-43821d2df211
2026-03-30 08:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca6458d0>
2026-03-30 08:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_97f48d78761ce67be94d1210e95a0af6.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_97f48d78761ce67be94d1210e95a0af6.jpg saved to cache
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9
2026-03-30 08:31:07 [scrapy.extensions.logstats] INFO: Crawled 41 pages (at 41 pages/min), scraped 59 items (at 59 items/min)
2026-03-30 08:31:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 175MiB
2026-03-30 08:31:07 [auto1.be] INFO: Found listing with ID: XV45416
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV45416%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [auto1.be] INFO: Scrape type for XV45416: 2
2026-03-30 08:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 161416b9-b9e0-5cd4-bcc7-e5061e51a820 with identifier: XV45416
2026-03-30 08:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 161416b9-b9e0-5cd4-bcc7-e5061e51a820 with scrape type 2
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 161416b9-b9e0-5cd4-bcc7-e5061e51a820 with scrape type 2
2026-03-30 08:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 161416b9-b9e0-5cd4-bcc7-e5061e51a820, identifier: XV45416
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_9729204b992502239e890bbec443b670.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_9729204b992502239e890bbec443b670.jpg not downloaded yet
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_d56d5cb843483f5b8e57103b1d495edb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_d56d5cb843483f5b8e57103b1d495edb.jpg not downloaded yet
2026-03-30 08:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c44c7c12-3de4-5671-a5b2-8af60d26bd6d with identifier: CD49334
2026-03-30 08:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c44c7c12-3de4-5671-a5b2-8af60d26bd6d with scrape type 1
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c44c7c12-3de4-5671-a5b2-8af60d26bd6d
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fea%252F58ea777f9e8975884f023dfd5b35b9fd%252Fpa%252FCD49334_2a9878c8af2b027fad03e864a4529836.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_2a9878c8af2b027fad03e864a4529836.jpg already downloaded
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fea%252F58ea777f9e8975884f023dfd5b35b9fd%252Fpa%252FCD49334_393f9a75405505a168447e35dfcecdec.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_393f9a75405505a168447e35dfcecdec.jpg already downloaded
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fea%252F58ea777f9e8975884f023dfd5b35b9fd%252Fpa%252FCD49334_6a2d34a105ddb3a8e64723b0edf73e46.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_6a2d34a105ddb3a8e64723b0edf73e46.jpg already downloaded
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fea%252F58ea777f9e8975884f023dfd5b35b9fd%252Fpa%252FCD49334_97017895b190d68fbd1a7bf79597279a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_97017895b190d68fbd1a7bf79597279a.jpg already downloaded
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fea%252F58ea777f9e8975884f023dfd5b35b9fd%252Fpa%252FCD49334_c078100ea0e86885085e0f39abd8ab65.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_c078100ea0e86885085e0f39abd8ab65.jpg already downloaded
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fea%252F58ea777f9e8975884f023dfd5b35b9fd%252Fpa%252FCD49334_02d88adac37269d2d98ddde3792fcd3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_02d88adac37269d2d98ddde3792fcd3e.jpg already downloaded
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fea%252F58ea777f9e8975884f023dfd5b35b9fd%252Fpa%252FCD49334_11bd452f61b7214cbf6eb868c0460fd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_11bd452f61b7214cbf6eb868c0460fd6.jpg already downloaded
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fea%252F58ea777f9e8975884f023dfd5b35b9fd%252Fpa%252FCD49334_62841a8f8d7b536df671d96bd0f646d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_62841a8f8d7b536df671d96bd0f646d5.jpg already downloaded
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fea%252F58ea777f9e8975884f023dfd5b35b9fd%252Fpa%252FCD49334_9ebafc9cad44d4a380c78516ab94e062.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_9ebafc9cad44d4a380c78516ab94e062.jpg already downloaded
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fea%252F58ea777f9e8975884f023dfd5b35b9fd%252Fpa%252FCD49334_86cafb4d66269540ca00eaad28209028.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_86cafb4d66269540ca00eaad28209028.jpg already downloaded
2026-03-30 08:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c44c7c12-3de4-5671-a5b2-8af60d26bd6d, identifier: CD49334
2026-03-30 08:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 161416b9-b9e0-5cd4-bcc7-e5061e51a820 with identifier: XV45416
2026-03-30 08:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 161416b9-b9e0-5cd4-bcc7-e5061e51a820 with identifier: XV45416
2026-03-30 08:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 161416b9-b9e0-5cd4-bcc7-e5061e51a820 with identifier: XV45416 to the API
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:52:41Z',
 'fuel_type': 'diesel',
 'id': '161416b9-b9e0-5cd4-bcc7-e5061e51a820',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV45416',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 204590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-25',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 116 CDI RWD lang',
 'transmission': 'automatic',
 'trim': 'RWD lang',
 'year': 2021}
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV45416%27 HTTP/1.1" 200 None
2026-03-30 08:31:07 [auto1.be] INFO: Saving data for XV45416: {'auction_closing_time': 1774972361.0, 'created_time': 1773693892.100567, 'last_price_update_time': 1774859467.933026}
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XV45416') HTTP/1.1" 204 0
2026-03-30 08:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c44c7c12-3de4-5671-a5b2-8af60d26bd6d with identifier: CD49334
2026-03-30 08:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c44c7c12-3de4-5671-a5b2-8af60d26bd6d with identifier: CD49334
2026-03-30 08:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c44c7c12-3de4-5671-a5b2-8af60d26bd6d with identifier: CD49334 to the API
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CD49334>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:33:06Z',
 'fuel_type': 'petrol',
 'id': 'c44c7c12-3de4-5671-a5b2-8af60d26bd6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD49334',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 70880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_2a9878c8af2b027fad03e864a4529836.jpg',
                'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_393f9a75405505a168447e35dfcecdec.jpg',
                'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_6a2d34a105ddb3a8e64723b0edf73e46.jpg',
                'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_97017895b190d68fbd1a7bf79597279a.jpg',
                'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_c078100ea0e86885085e0f39abd8ab65.jpg',
                'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_02d88adac37269d2d98ddde3792fcd3e.jpg',
                'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_11bd452f61b7214cbf6eb868c0460fd6.jpg',
                'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_62841a8f8d7b536df671d96bd0f646d5.jpg',
                'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_9ebafc9cad44d4a380c78516ab94e062.jpg',
                'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_86cafb4d66269540ca00eaad28209028.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c44c7c12-3de4-5671-a5b2-8af60d26bd6d/c44c7c12-3de4-5671-a5b2-8af60d26bd6d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_2a9878c8af2b027fad03e864a4529836.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c44c7c12-3de4-5671-a5b2-8af60d26bd6d/c44c7c12-3de4-5671-a5b2-8af60d26bd6d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_393f9a75405505a168447e35dfcecdec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c44c7c12-3de4-5671-a5b2-8af60d26bd6d/c44c7c12-3de4-5671-a5b2-8af60d26bd6d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_6a2d34a105ddb3a8e64723b0edf73e46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c44c7c12-3de4-5671-a5b2-8af60d26bd6d/c44c7c12-3de4-5671-a5b2-8af60d26bd6d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_97017895b190d68fbd1a7bf79597279a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c44c7c12-3de4-5671-a5b2-8af60d26bd6d/c44c7c12-3de4-5671-a5b2-8af60d26bd6d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_c078100ea0e86885085e0f39abd8ab65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c44c7c12-3de4-5671-a5b2-8af60d26bd6d/c44c7c12-3de4-5671-a5b2-8af60d26bd6d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_02d88adac37269d2d98ddde3792fcd3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c44c7c12-3de4-5671-a5b2-8af60d26bd6d/c44c7c12-3de4-5671-a5b2-8af60d26bd6d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_11bd452f61b7214cbf6eb868c0460fd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c44c7c12-3de4-5671-a5b2-8af60d26bd6d/c44c7c12-3de4-5671-a5b2-8af60d26bd6d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_62841a8f8d7b536df671d96bd0f646d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c44c7c12-3de4-5671-a5b2-8af60d26bd6d/c44c7c12-3de4-5671-a5b2-8af60d26bd6d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_9ebafc9cad44d4a380c78516ab94e062.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c44c7c12-3de4-5671-a5b2-8af60d26bd6d/c44c7c12-3de4-5671-a5b2-8af60d26bd6d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ea/58ea777f9e8975884f023dfd5b35b9fd/pa/CD49334_86cafb4d66269540ca00eaad28209028.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.0 VTi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2016}
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD49334%27 HTTP/1.1" 200 None
2026-03-30 08:31:08 [auto1.be] INFO: Saving data for CD49334: {'created_time': 1774859468.274257, 'last_price_update_time': 1774859468.274269, 'auction_closing_time': 1774971186.0}
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CD49334') HTTP/1.1" 204 0
2026-03-30 08:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c94dbf90>
2026-03-30 08:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_790bb7d0d1953560f68b2dbf03011313.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_790bb7d0d1953560f68b2dbf03011313.jpg saved to cache
2026-03-30 08:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0889cab-78aa-527c-b0dc-43821d2df211
2026-03-30 08:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_485ed94fa9c002c51a6f512d29a80339.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:08 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE43146%27 HTTP/1.1" 200 None
2026-03-30 08:31:08 [auto1.be] INFO: Scrape type for UE43146: 2
2026-03-30 08:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e99c6370-3c28-520f-af64-ef1a4351f6c2 with identifier: UE43146
2026-03-30 08:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e99c6370-3c28-520f-af64-ef1a4351f6c2 with scrape type 2
2026-03-30 08:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e99c6370-3c28-520f-af64-ef1a4351f6c2 with scrape type 2
2026-03-30 08:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e99c6370-3c28-520f-af64-ef1a4351f6c2, identifier: UE43146
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_26c24aa6a5562173c9c61f670c688b01.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_26c24aa6a5562173c9c61f670c688b01.jpg not downloaded yet
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_d0440e1012516bcdf5ac68528d4cccd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_d0440e1012516bcdf5ac68528d4cccd9.jpg not downloaded yet
2026-03-30 08:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7d4810>
2026-03-30 08:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_6376390b0655476b51df4bd1fa7f0961.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_6376390b0655476b51df4bd1fa7f0961.jpg saved to cache
2026-03-30 08:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0889cab-78aa-527c-b0dc-43821d2df211
2026-03-30 08:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c95dc590>
2026-03-30 08:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_95072e045e440d484a6fd8a993b89db5.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_95072e045e440d484a6fd8a993b89db5.jpg saved to cache
2026-03-30 08:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9
2026-03-30 08:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_e91bd2338ee4300652d3e9552e9110d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e99c6370-3c28-520f-af64-ef1a4351f6c2 with identifier: UE43146
2026-03-30 08:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e99c6370-3c28-520f-af64-ef1a4351f6c2 with identifier: UE43146
2026-03-30 08:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e99c6370-3c28-520f-af64-ef1a4351f6c2 with identifier: UE43146 to the API
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 345,
 'expiration_date': '2026-03-31T15:21:18Z',
 'fuel_type': 'hybrid',
 'id': 'e99c6370-3c28-520f-af64-ef1a4351f6c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE43146',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'GS-Serie',
 'odometer': 157587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-03',
 'seller_name': None,
 'title': 'Lexus GS-Serie GS 450h',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE43146%27 HTTP/1.1" 200 None
2026-03-30 08:31:08 [auto1.be] INFO: Saving data for UE43146: {'auction_closing_time': 1774970478.0, 'created_time': 1774125150.46042, 'last_price_update_time': 1774859468.913431}
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UE43146') HTTP/1.1" 204 0
2026-03-30 08:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU28808> (referer: https://www.auto1.com/v1/car-details-view/FU28808/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:08 [auto1.be] INFO: Found listing with ID: HL05710
2026-03-30 08:31:08 [auto1.be] INFO: Found listing with ID: NH80895
2026-03-30 08:31:08 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-30 08:31:08 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD69002%27 HTTP/1.1" 200 None
2026-03-30 08:31:08 [auto1.be] INFO: Scrape type for SD69002: 2
2026-03-30 08:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f with identifier: SD69002
2026-03-30 08:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f with scrape type 2
2026-03-30 08:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f with scrape type 2
2026-03-30 08:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f, identifier: SD69002
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_4b8b3838b89f184d2fa44276186646e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_4b8b3838b89f184d2fa44276186646e3.jpg not downloaded yet
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_73f5cf872b4817dc4c43e49c899263b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_73f5cf872b4817dc4c43e49c899263b6.jpg not downloaded yet
2026-03-30 08:31:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX41368> (referer: https://www.auto1.com/v1/car-details-view/CX41368/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f with identifier: SD69002
2026-03-30 08:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f with identifier: SD69002
2026-03-30 08:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f with identifier: SD69002 to the API
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:34:04Z',
 'fuel_type': 'diesel',
 'id': '7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD69002',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 211324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-17',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Maxi Trendline',
 'transmission': 'manual',
 'trim': 'Maxi Trendline',
 'year': 2015}
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD69002%27 HTTP/1.1" 200 None
2026-03-30 08:31:09 [auto1.be] INFO: Saving data for SD69002: {'auction_closing_time': 1774971244.0, 'created_time': 1774470939.148712, 'last_price_update_time': 1774859469.414734}
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD69002') HTTP/1.1" 204 0
2026-03-30 08:31:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca8a7b50>
2026-03-30 08:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_485ed94fa9c002c51a6f512d29a80339.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_485ed94fa9c002c51a6f512d29a80339.jpg saved to cache
2026-03-30 08:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0889cab-78aa-527c-b0dc-43821d2df211
2026-03-30 08:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_d56d5cb843483f5b8e57103b1d495edb.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:09 [auto1.be] INFO: Found listing with ID: GX79489
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX79489%27 HTTP/1.1" 200 None
2026-03-30 08:31:09 [auto1.be] INFO: Scrape type for GX79489: 2
2026-03-30 08:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a10cf16-4b6a-5865-b2ef-65fdfc3283ce with identifier: GX79489
2026-03-30 08:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a10cf16-4b6a-5865-b2ef-65fdfc3283ce with scrape type 2
2026-03-30 08:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a10cf16-4b6a-5865-b2ef-65fdfc3283ce with scrape type 2
2026-03-30 08:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1a10cf16-4b6a-5865-b2ef-65fdfc3283ce, identifier: GX79489
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_4b0d44824f10ed71164ccc5fb7d15347.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_4b0d44824f10ed71164ccc5fb7d15347.jpg not downloaded yet
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_054f11a6bd354d2f4ceec3662cf8b211.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_054f11a6bd354d2f4ceec3662cf8b211.jpg not downloaded yet
2026-03-30 08:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7ca210>
2026-03-30 08:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_e91bd2338ee4300652d3e9552e9110d8.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_e91bd2338ee4300652d3e9552e9110d8.jpg saved to cache
2026-03-30 08:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9
2026-03-30 08:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_9729204b992502239e890bbec443b670.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1a10cf16-4b6a-5865-b2ef-65fdfc3283ce with identifier: GX79489
2026-03-30 08:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1a10cf16-4b6a-5865-b2ef-65fdfc3283ce with identifier: GX79489
2026-03-30 08:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1a10cf16-4b6a-5865-b2ef-65fdfc3283ce with identifier: GX79489 to the API
2026-03-30 08:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:18:12Z',
 'fuel_type': 'petrol',
 'id': '1a10cf16-4b6a-5865-b2ef-65fdfc3283ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX79489',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 137192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX79489%27 HTTP/1.1" 200 None
2026-03-30 08:31:11 [auto1.be] INFO: Saving data for GX79489: {'auction_closing_time': 1774970292.0, 'created_time': 1774470986.335563, 'last_price_update_time': 1774859471.184043}
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GX79489') HTTP/1.1" 204 0
2026-03-30 08:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a740f60-629c-5dfd-a0c4-f760f6169e45 with identifier: FU28808
2026-03-30 08:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a740f60-629c-5dfd-a0c4-f760f6169e45 with scrape type 1
2026-03-30 08:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a740f60-629c-5dfd-a0c4-f760f6169e45
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_963c12f4e423a5fec420f9a03495f42c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_963c12f4e423a5fec420f9a03495f42c.jpg not downloaded yet
2026-03-30 08:31:11 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW33850%27 HTTP/1.1" 200 None
2026-03-30 08:31:11 [auto1.be] INFO: Scrape type for WW33850: 2
2026-03-30 08:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89817c9e-19cb-5360-947c-47d8de676c21 with identifier: WW33850
2026-03-30 08:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89817c9e-19cb-5360-947c-47d8de676c21 with scrape type 2
2026-03-30 08:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89817c9e-19cb-5360-947c-47d8de676c21 with scrape type 2
2026-03-30 08:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 89817c9e-19cb-5360-947c-47d8de676c21, identifier: WW33850
2026-03-30 08:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40f761ae-422f-51df-982b-d78958ba3eb6 with identifier: CX41368
2026-03-30 08:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40f761ae-422f-51df-982b-d78958ba3eb6 with scrape type 1
2026-03-30 08:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 40f761ae-422f-51df-982b-d78958ba3eb6
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fef%252Fcaef3bfa4e2f427ed7b97c012a3d9610%252Fpa%252FCX41368_5d8771dcb1378d4deb150be753d138c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_5d8771dcb1378d4deb150be753d138c1.jpg already downloaded
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fef%252Fcaef3bfa4e2f427ed7b97c012a3d9610%252Fpa%252FCX41368_b24786715f9b11174927f6c42da857f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_b24786715f9b11174927f6c42da857f0.jpg already downloaded
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fef%252Fcaef3bfa4e2f427ed7b97c012a3d9610%252Fpa%252FCX41368_6e9316ea385715f4c0ed4bc2a410e0e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_6e9316ea385715f4c0ed4bc2a410e0e8.jpg already downloaded
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fef%252Fcaef3bfa4e2f427ed7b97c012a3d9610%252Fpa%252FCX41368_6c44f507da3de50224586843072f1150.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_6c44f507da3de50224586843072f1150.jpg already downloaded
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fef%252Fcaef3bfa4e2f427ed7b97c012a3d9610%252Fpa%252FCX41368_7372a19009703ed7a92ede307dddd823.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_7372a19009703ed7a92ede307dddd823.jpg already downloaded
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fef%252Fcaef3bfa4e2f427ed7b97c012a3d9610%252Fpa%252FCX41368_0de5d6e21f00f2c1bfc1dbb6b13e20c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_0de5d6e21f00f2c1bfc1dbb6b13e20c1.jpg already downloaded
2026-03-30 08:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 40f761ae-422f-51df-982b-d78958ba3eb6, identifier: CX41368
2026-03-30 08:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_d0440e1012516bcdf5ac68528d4cccd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 89817c9e-19cb-5360-947c-47d8de676c21 with identifier: WW33850
2026-03-30 08:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 89817c9e-19cb-5360-947c-47d8de676c21 with identifier: WW33850
2026-03-30 08:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 89817c9e-19cb-5360-947c-47d8de676c21 with identifier: WW33850 to the API
2026-03-30 08:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:11:52Z',
 'fuel_type': 'diesel',
 'id': '89817c9e-19cb-5360-947c-47d8de676c21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW33850',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 147300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-18',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2014}
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW33850%27 HTTP/1.1" 200 None
2026-03-30 08:31:12 [auto1.be] INFO: Saving data for WW33850: {'auction_closing_time': 1774969912.0, 'created_time': 1773136447.881673, 'last_price_update_time': 1774859472.278674}
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WW33850') HTTP/1.1" 204 0
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_452b235847678eb2aaa78ae1c68036b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_452b235847678eb2aaa78ae1c68036b8.jpg not downloaded yet
2026-03-30 08:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 40f761ae-422f-51df-982b-d78958ba3eb6 with identifier: CX41368
2026-03-30 08:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 40f761ae-422f-51df-982b-d78958ba3eb6 with identifier: CX41368
2026-03-30 08:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 40f761ae-422f-51df-982b-d78958ba3eb6 with identifier: CX41368 to the API
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CX41368>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:35:39Z',
 'fuel_type': 'diesel',
 'id': '40f761ae-422f-51df-982b-d78958ba3eb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX41368',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 303681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_5d8771dcb1378d4deb150be753d138c1.jpg',
                'https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_b24786715f9b11174927f6c42da857f0.jpg',
                'https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_6e9316ea385715f4c0ed4bc2a410e0e8.jpg',
                'https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_6c44f507da3de50224586843072f1150.jpg',
                'https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_7372a19009703ed7a92ede307dddd823.jpg',
                'https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_0de5d6e21f00f2c1bfc1dbb6b13e20c1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f761ae-422f-51df-982b-d78958ba3eb6/40f761ae-422f-51df-982b-d78958ba3eb6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_5d8771dcb1378d4deb150be753d138c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f761ae-422f-51df-982b-d78958ba3eb6/40f761ae-422f-51df-982b-d78958ba3eb6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_b24786715f9b11174927f6c42da857f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f761ae-422f-51df-982b-d78958ba3eb6/40f761ae-422f-51df-982b-d78958ba3eb6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_6e9316ea385715f4c0ed4bc2a410e0e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f761ae-422f-51df-982b-d78958ba3eb6/40f761ae-422f-51df-982b-d78958ba3eb6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_6c44f507da3de50224586843072f1150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f761ae-422f-51df-982b-d78958ba3eb6/40f761ae-422f-51df-982b-d78958ba3eb6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_7372a19009703ed7a92ede307dddd823.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f761ae-422f-51df-982b-d78958ba3eb6/40f761ae-422f-51df-982b-d78958ba3eb6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ef/caef3bfa4e2f427ed7b97c012a3d9610/pa/CX41368_0de5d6e21f00f2c1bfc1dbb6b13e20c1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Kia Carens 1.7 CRDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX41368%27 HTTP/1.1" 200 None
2026-03-30 08:31:12 [auto1.be] INFO: Saving data for CX41368: {'created_time': 1774859472.645706, 'last_price_update_time': 1774859472.645717, 'auction_closing_time': 1774971339.0}
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CX41368') HTTP/1.1" 204 0
2026-03-30 08:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6cc671950>
2026-03-30 08:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_d56d5cb843483f5b8e57103b1d495edb.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_d56d5cb843483f5b8e57103b1d495edb.jpg saved to cache
2026-03-30 08:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0889cab-78aa-527c-b0dc-43821d2df211
2026-03-30 08:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_73f5cf872b4817dc4c43e49c899263b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_26c24aa6a5562173c9c61f670c688b01.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:12 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-30 08:31:12 [auto1.be] INFO: Found listing with ID: AU97754
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU97754%27 HTTP/1.1" 200 None
2026-03-30 08:31:12 [auto1.be] INFO: Scrape type for AU97754: 2
2026-03-30 08:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abca3880-326f-5f6c-a7e6-9e5f8920c7bf with identifier: AU97754
2026-03-30 08:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abca3880-326f-5f6c-a7e6-9e5f8920c7bf with scrape type 2
2026-03-30 08:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abca3880-326f-5f6c-a7e6-9e5f8920c7bf with scrape type 2
2026-03-30 08:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: abca3880-326f-5f6c-a7e6-9e5f8920c7bf, identifier: AU97754
2026-03-30 08:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH39924/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS30663> (referer: https://www.auto1.com/v1/car-details-view/GS30663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9380e90>
2026-03-30 08:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_9729204b992502239e890bbec443b670.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_9729204b992502239e890bbec443b670.jpg saved to cache
2026-03-30 08:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9
2026-03-30 08:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: abca3880-326f-5f6c-a7e6-9e5f8920c7bf with identifier: AU97754
2026-03-30 08:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: abca3880-326f-5f6c-a7e6-9e5f8920c7bf with identifier: AU97754
2026-03-30 08:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: abca3880-326f-5f6c-a7e6-9e5f8920c7bf with identifier: AU97754 to the API
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:47:16Z',
 'fuel_type': 'petrol',
 'id': 'abca3880-326f-5f6c-a7e6-9e5f8920c7bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU97754',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Pluriel',
 'odometer': 94964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-24',
 'seller_name': None,
 'title': 'Citroen C3 Pluriel 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2007}
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU97754%27 HTTP/1.1" 200 None
2026-03-30 08:31:13 [auto1.be] INFO: Saving data for AU97754: {'auction_closing_time': 1774972036.0, 'created_time': 1774006259.031814, 'last_price_update_time': 1774859473.318723}
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AU97754') HTTP/1.1" 204 0
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_9227d992897ab54f89ff5f232c4805eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_9227d992897ab54f89ff5f232c4805eb.jpg not downloaded yet
2026-03-30 08:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN58348> (referer: https://www.auto1.com/v1/car-details-view/GN58348/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_4b8b3838b89f184d2fa44276186646e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:13 [auto1.be] INFO: Found listing with ID: AH26966
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AH26966%27 HTTP/1.1" 200 None
2026-03-30 08:31:13 [auto1.be] INFO: Scrape type for AH26966: 2
2026-03-30 08:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6522b0-3c38-583e-988c-54ec7d7ecbff with identifier: AH26966
2026-03-30 08:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6522b0-3c38-583e-988c-54ec7d7ecbff with scrape type 2
2026-03-30 08:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6522b0-3c38-583e-988c-54ec7d7ecbff with scrape type 2
2026-03-30 08:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d6522b0-3c38-583e-988c-54ec7d7ecbff, identifier: AH26966
2026-03-30 08:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH91226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9439c10>
2026-03-30 08:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_d0440e1012516bcdf5ac68528d4cccd9.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_d0440e1012516bcdf5ac68528d4cccd9.jpg saved to cache
2026-03-30 08:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0889cab-78aa-527c-b0dc-43821d2df211
2026-03-30 08:31:13 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1492 | hits on page: 40
2026-03-30 08:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d6522b0-3c38-583e-988c-54ec7d7ecbff with identifier: AH26966
2026-03-30 08:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d6522b0-3c38-583e-988c-54ec7d7ecbff with identifier: AH26966
2026-03-30 08:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d6522b0-3c38-583e-988c-54ec7d7ecbff with identifier: AH26966 to the API
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:27:18Z',
 'fuel_type': 'petrol',
 'id': '8d6522b0-3c38-583e-988c-54ec7d7ecbff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH26966',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 188309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-01',
 'seller_name': None,
 'title': 'Toyota Auris 1.3 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2011}
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AH26966%27 HTTP/1.1" 200 None
2026-03-30 08:31:13 [auto1.be] INFO: Saving data for AH26966: {'auction_closing_time': 1774970838.0, 'created_time': 1773237822.520033, 'last_price_update_time': 1774859473.886}
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AH26966') HTTP/1.1" 204 0
2026-03-30 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_68e98553930cea71a4df582e6b7e93c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_68e98553930cea71a4df582e6b7e93c2.jpg not downloaded yet
2026-03-30 08:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca799c50>
2026-03-30 08:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_73f5cf872b4817dc4c43e49c899263b6.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_73f5cf872b4817dc4c43e49c899263b6.jpg saved to cache
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e0889cab-78aa-527c-b0dc-43821d2df211
2026-03-30 08:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c954ee10>
2026-03-30 08:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_26c24aa6a5562173c9c61f670c688b01.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_26c24aa6a5562173c9c61f670c688b01.jpg saved to cache
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9
2026-03-30 08:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_054f11a6bd354d2f4ceec3662cf8b211.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_963c12f4e423a5fec420f9a03495f42c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:14 [auto1.be] INFO: Found listing with ID: YU57960
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU57960%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [auto1.be] INFO: Scrape type for YU57960: 2
2026-03-30 08:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8685d96-b652-51e0-87b5-f4c29b80fcaf with identifier: YU57960
2026-03-30 08:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8685d96-b652-51e0-87b5-f4c29b80fcaf with scrape type 2
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8685d96-b652-51e0-87b5-f4c29b80fcaf with scrape type 2
2026-03-30 08:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b8685d96-b652-51e0-87b5-f4c29b80fcaf, identifier: YU57960
2026-03-30 08:31:14 [auto1.be] INFO: Found listing with ID: PK81975
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK81975%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [auto1.be] INFO: Scrape type for PK81975: 1
2026-03-30 08:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_ecc2fcf5795058acba5a11b3ed59292c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b8685d96-b652-51e0-87b5-f4c29b80fcaf with identifier: YU57960
2026-03-30 08:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b8685d96-b652-51e0-87b5-f4c29b80fcaf with identifier: YU57960
2026-03-30 08:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b8685d96-b652-51e0-87b5-f4c29b80fcaf with identifier: YU57960 to the API
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:56:45Z',
 'fuel_type': 'diesel',
 'id': 'b8685d96-b652-51e0-87b5-f4c29b80fcaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU57960',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 345577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-31',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU57960%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [auto1.be] INFO: Saving data for YU57960: {'auction_closing_time': 1774972605.0, 'created_time': 1773238099.392843, 'last_price_update_time': 1774859474.529113}
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YU57960') HTTP/1.1" 204 0
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_b49c853dd725a8380c54f5294521fcc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_b49c853dd725a8380c54f5294521fcc1.jpg not downloaded yet
2026-03-30 08:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a254d639-79a5-50cf-b3f7-b1dd9c861eb4 with identifier: GS30663
2026-03-30 08:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4 with scrape type 1
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_b5a10072364cb67f227e668032a804f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_b5a10072364cb67f227e668032a804f8.jpg not downloaded yet
2026-03-30 08:31:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 918a4e5c-f14a-5734-8177-31fff1a514cc with identifier: GN58348
2026-03-30 08:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 918a4e5c-f14a-5734-8177-31fff1a514cc with scrape type 1
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 918a4e5c-f14a-5734-8177-31fff1a514cc
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fee%252Fd9ee24e9f2cf2eda64cf5b04bfaa57bc%252Fpa%252FGN58348_5e79c9e5ef76917f18536e9d636a4889.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_5e79c9e5ef76917f18536e9d636a4889.jpg already downloaded
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fee%252Fd9ee24e9f2cf2eda64cf5b04bfaa57bc%252Fpa%252FGN58348_ec85898d59b6d9be41084ea85cbf39dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_ec85898d59b6d9be41084ea85cbf39dd.jpg already downloaded
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fee%252Fd9ee24e9f2cf2eda64cf5b04bfaa57bc%252Fpa%252FGN58348_6fea0f5e51de07632e6d4026dccd2323.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_6fea0f5e51de07632e6d4026dccd2323.jpg already downloaded
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fee%252Fd9ee24e9f2cf2eda64cf5b04bfaa57bc%252Fpa%252FGN58348_1d9626b5fd481f0584636c6f5bc7ed4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_1d9626b5fd481f0584636c6f5bc7ed4d.jpg already downloaded
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fee%252Fd9ee24e9f2cf2eda64cf5b04bfaa57bc%252Fpa%252FGN58348_ab2f426a62b66b141131911370e72673.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_ab2f426a62b66b141131911370e72673.jpg already downloaded
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fee%252Fd9ee24e9f2cf2eda64cf5b04bfaa57bc%252Fpa%252FGN58348_910253a65704109009ff86ffefd11dae.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_910253a65704109009ff86ffefd11dae.jpg already downloaded
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fee%252Fd9ee24e9f2cf2eda64cf5b04bfaa57bc%252Fpa%252FGN58348_ca365940128cb735a20dd571230bda74.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_ca365940128cb735a20dd571230bda74.jpg already downloaded
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fee%252Fd9ee24e9f2cf2eda64cf5b04bfaa57bc%252Fpa%252FGN58348_aad4e913123be2b4a66e3fd1d4991940.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_aad4e913123be2b4a66e3fd1d4991940.jpg already downloaded
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fee%252Fd9ee24e9f2cf2eda64cf5b04bfaa57bc%252Fpa%252FGN58348_77b2b2847639d4e8fcd2d3c40e48bef7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_77b2b2847639d4e8fcd2d3c40e48bef7.jpg already downloaded
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fee%252Fd9ee24e9f2cf2eda64cf5b04bfaa57bc%252Fpa%252FGN58348_55f1e52cdc3fa772f404e6c301be7293.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_55f1e52cdc3fa772f404e6c301be7293.jpg already downloaded
2026-03-30 08:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 918a4e5c-f14a-5734-8177-31fff1a514cc, identifier: GN58348
2026-03-30 08:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca776090>
2026-03-30 08:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_4b8b3838b89f184d2fa44276186646e3.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_4b8b3838b89f184d2fa44276186646e3.jpg saved to cache
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9
2026-03-30 08:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_4b0d44824f10ed71164ccc5fb7d15347.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:14 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-30 08:31:14 [auto1.be] INFO: Found listing with ID: GD38693
2026-03-30 08:31:14 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD01441%27 HTTP/1.1" 200 None
2026-03-30 08:31:14 [auto1.be] INFO: Scrape type for KD01441: 2
2026-03-30 08:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd743dc-3036-5603-a49b-b94cbcac5b4f with identifier: KD01441
2026-03-30 08:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd743dc-3036-5603-a49b-b94cbcac5b4f with scrape type 2
2026-03-30 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fd743dc-3036-5603-a49b-b94cbcac5b4f with scrape type 2
2026-03-30 08:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7fd743dc-3036-5603-a49b-b94cbcac5b4f, identifier: KD01441
2026-03-30 08:31:15 [auto1.be] INFO: Found listing with ID: JJ16156
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ16156%27 HTTP/1.1" 200 None
2026-03-30 08:31:15 [auto1.be] INFO: Scrape type for JJ16156: 1
2026-03-30 08:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 918a4e5c-f14a-5734-8177-31fff1a514cc with identifier: GN58348
2026-03-30 08:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 918a4e5c-f14a-5734-8177-31fff1a514cc with identifier: GN58348
2026-03-30 08:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 918a4e5c-f14a-5734-8177-31fff1a514cc with identifier: GN58348 to the API
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GN58348>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:48:45Z',
 'fuel_type': 'diesel',
 'id': '918a4e5c-f14a-5734-8177-31fff1a514cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN58348',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 193604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_5e79c9e5ef76917f18536e9d636a4889.jpg',
                'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_ec85898d59b6d9be41084ea85cbf39dd.jpg',
                'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_6fea0f5e51de07632e6d4026dccd2323.jpg',
                'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_1d9626b5fd481f0584636c6f5bc7ed4d.jpg',
                'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_ab2f426a62b66b141131911370e72673.jpg',
                'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_910253a65704109009ff86ffefd11dae.jpg',
                'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_ca365940128cb735a20dd571230bda74.jpg',
                'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_aad4e913123be2b4a66e3fd1d4991940.jpg',
                'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_77b2b2847639d4e8fcd2d3c40e48bef7.jpg',
                'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_55f1e52cdc3fa772f404e6c301be7293.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918a4e5c-f14a-5734-8177-31fff1a514cc/918a4e5c-f14a-5734-8177-31fff1a514cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_5e79c9e5ef76917f18536e9d636a4889.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918a4e5c-f14a-5734-8177-31fff1a514cc/918a4e5c-f14a-5734-8177-31fff1a514cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_ec85898d59b6d9be41084ea85cbf39dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918a4e5c-f14a-5734-8177-31fff1a514cc/918a4e5c-f14a-5734-8177-31fff1a514cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_6fea0f5e51de07632e6d4026dccd2323.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918a4e5c-f14a-5734-8177-31fff1a514cc/918a4e5c-f14a-5734-8177-31fff1a514cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_1d9626b5fd481f0584636c6f5bc7ed4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918a4e5c-f14a-5734-8177-31fff1a514cc/918a4e5c-f14a-5734-8177-31fff1a514cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_ab2f426a62b66b141131911370e72673.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918a4e5c-f14a-5734-8177-31fff1a514cc/918a4e5c-f14a-5734-8177-31fff1a514cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_910253a65704109009ff86ffefd11dae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918a4e5c-f14a-5734-8177-31fff1a514cc/918a4e5c-f14a-5734-8177-31fff1a514cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_ca365940128cb735a20dd571230bda74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918a4e5c-f14a-5734-8177-31fff1a514cc/918a4e5c-f14a-5734-8177-31fff1a514cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_aad4e913123be2b4a66e3fd1d4991940.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918a4e5c-f14a-5734-8177-31fff1a514cc/918a4e5c-f14a-5734-8177-31fff1a514cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_77b2b2847639d4e8fcd2d3c40e48bef7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918a4e5c-f14a-5734-8177-31fff1a514cc/918a4e5c-f14a-5734-8177-31fff1a514cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ee/d9ee24e9f2cf2eda64cf5b04bfaa57bc/pa/GN58348_55f1e52cdc3fa772f404e6c301be7293.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2015}
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN58348%27 HTTP/1.1" 200 None
2026-03-30 08:31:15 [auto1.be] INFO: Saving data for GN58348: {'created_time': 1774859475.38689, 'last_price_update_time': 1774859475.386903, 'auction_closing_time': 1774972125.0}
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GN58348') HTTP/1.1" 204 0
2026-03-30 08:31:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7fd743dc-3036-5603-a49b-b94cbcac5b4f with identifier: KD01441
2026-03-30 08:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7fd743dc-3036-5603-a49b-b94cbcac5b4f with identifier: KD01441
2026-03-30 08:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7fd743dc-3036-5603-a49b-b94cbcac5b4f with identifier: KD01441 to the API
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:06:00Z',
 'fuel_type': 'petrol',
 'id': '7fd743dc-3036-5603-a49b-b94cbcac5b4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD01441',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 120909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-17',
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD01441%27 HTTP/1.1" 200 None
2026-03-30 08:31:15 [auto1.be] INFO: Saving data for KD01441: {'auction_closing_time': 1774969560.0, 'created_time': 1774438231.66082, 'last_price_update_time': 1774859475.724477}
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KD01441') HTTP/1.1" 204 0
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_db1e8cde27c8f6b42233d77b3d2ff92b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_db1e8cde27c8f6b42233d77b3d2ff92b.jpg not downloaded yet
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_509ea976703f75f64086828925af3944.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_509ea976703f75f64086828925af3944.jpg not downloaded yet
2026-03-30 08:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY44449> (referer: https://www.auto1.com/v1/car-details-view/XY44449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_6d789b0484d551b01924044e52cf53cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:15 [auto1.be] INFO: Found listing with ID: PH52818
2026-03-30 08:31:15 [auto1.be] INFO: Found listing with ID: DA58595
2026-03-30 08:31:15 [auto1.be] INFO: Found listing with ID: PL94274
2026-03-30 08:31:15 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX58483%27 HTTP/1.1" 200 None
2026-03-30 08:31:15 [auto1.be] INFO: Scrape type for ZX58483: 2
2026-03-30 08:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54e30372-8309-572c-be0e-4092fd077682 with identifier: ZX58483
2026-03-30 08:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54e30372-8309-572c-be0e-4092fd077682 with scrape type 2
2026-03-30 08:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54e30372-8309-572c-be0e-4092fd077682 with scrape type 2
2026-03-30 08:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 54e30372-8309-572c-be0e-4092fd077682, identifier: ZX58483
2026-03-30 08:31:15 [auto1.be] INFO: Found listing with ID: BM50316
2026-03-30 08:31:15 [auto1.be] INFO: Found listing with ID: GF12513
2026-03-30 08:31:15 [auto1.be] INFO: Found listing with ID: JA60978
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA60978%27 HTTP/1.1" 200 None
2026-03-30 08:31:15 [auto1.be] INFO: Scrape type for JA60978: 1
2026-03-30 08:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV23610> (referer: https://www.auto1.com/v1/car-details-view/ZV23610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9473450>
2026-03-30 08:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_054f11a6bd354d2f4ceec3662cf8b211.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_054f11a6bd354d2f4ceec3662cf8b211.jpg saved to cache
2026-03-30 08:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e0889cab-78aa-527c-b0dc-43821d2df211
2026-03-30 08:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c938a5d0>
2026-03-30 08:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_963c12f4e423a5fec420f9a03495f42c.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_963c12f4e423a5fec420f9a03495f42c.jpg saved to cache
2026-03-30 08:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a740f60-629c-5dfd-a0c4-f760f6169e45
2026-03-30 08:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9378210>
2026-03-30 08:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_ecc2fcf5795058acba5a11b3ed59292c.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_ecc2fcf5795058acba5a11b3ed59292c.jpg saved to cache
2026-03-30 08:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0889cab-78aa-527c-b0dc-43821d2df211
2026-03-30 08:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_452b235847678eb2aaa78ae1c68036b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_64b4b2c759d8bfad4ac50fc742e4a576.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 54e30372-8309-572c-be0e-4092fd077682 with identifier: ZX58483
2026-03-30 08:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 54e30372-8309-572c-be0e-4092fd077682 with identifier: ZX58483
2026-03-30 08:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 54e30372-8309-572c-be0e-4092fd077682 with identifier: ZX58483 to the API
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:49:23Z',
 'fuel_type': 'petrol',
 'id': '54e30372-8309-572c-be0e-4092fd077682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX58483',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 113905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-11',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2013}
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX58483%27 HTTP/1.1" 200 None
2026-03-30 08:31:16 [auto1.be] INFO: Saving data for ZX58483: {'auction_closing_time': 1774972163.0, 'created_time': 1773131705.623427, 'last_price_update_time': 1774859476.401491}
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX58483') HTTP/1.1" 204 0
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_38d815d9b350e349713763872a00bbe2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_38d815d9b350e349713763872a00bbe2.jpg not downloaded yet
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_fb518a5e66eae4397ea5b64fc48dbc61.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_fb518a5e66eae4397ea5b64fc48dbc61.jpg not downloaded yet
2026-03-30 08:31:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_f5a079359b645aa295ae0b5a1a3a4db3.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:16 [auto1.be] INFO: Found listing with ID: MX38879
2026-03-30 08:31:16 [auto1.be] INFO: Found listing with ID: RD04523
2026-03-30 08:31:16 [auto1.be] INFO: Found listing with ID: SG92006
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG92006%27 HTTP/1.1" 200 None
2026-03-30 08:31:16 [auto1.be] INFO: Scrape type for SG92006: 2
2026-03-30 08:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d634367-3e58-5a37-9e17-dac2a303261b with identifier: SG92006
2026-03-30 08:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d634367-3e58-5a37-9e17-dac2a303261b with scrape type 2
2026-03-30 08:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d634367-3e58-5a37-9e17-dac2a303261b with scrape type 2
2026-03-30 08:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2d634367-3e58-5a37-9e17-dac2a303261b, identifier: SG92006
2026-03-30 08:31:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9508750>
2026-03-30 08:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_4b0d44824f10ed71164ccc5fb7d15347.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_4b0d44824f10ed71164ccc5fb7d15347.jpg saved to cache
2026-03-30 08:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_111c5b6803f809ae566e3a06bd25f041.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_111c5b6803f809ae566e3a06bd25f041.jpg not downloaded yet
2026-03-30 08:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2d634367-3e58-5a37-9e17-dac2a303261b with identifier: SG92006
2026-03-30 08:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2d634367-3e58-5a37-9e17-dac2a303261b with identifier: SG92006
2026-03-30 08:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2d634367-3e58-5a37-9e17-dac2a303261b with identifier: SG92006 to the API
2026-03-30 08:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:05:56Z',
 'fuel_type': 'petrol',
 'id': '2d634367-3e58-5a37-9e17-dac2a303261b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG92006',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 39115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-28',
 'seller_name': None,
 'title': 'MINI Cooper John Works Trim',
 'transmission': 'automatic',
 'trim': 'John Works Trim',
 'year': 2022}
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG92006%27 HTTP/1.1" 200 None
2026-03-30 08:31:17 [auto1.be] INFO: Saving data for SG92006: {'auction_closing_time': 1774969556.0, 'created_time': 1774254724.413676, 'last_price_update_time': 1774859477.482399}
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SG92006') HTTP/1.1" 204 0
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_1237cf624e531eaa51913357e20620aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_1237cf624e531eaa51913357e20620aa.jpg not downloaded yet
2026-03-30 08:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eab36051-05b6-5133-8ea3-974f913fe1e8 with identifier: XY44449
2026-03-30 08:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eab36051-05b6-5133-8ea3-974f913fe1e8 with scrape type 1
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eab36051-05b6-5133-8ea3-974f913fe1e8
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F7043275bfaad53001b9c080237da7ac9%252Fpa%252FXY44449_c14ed94aa84af1ca7a98ba55e08c0482.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_c14ed94aa84af1ca7a98ba55e08c0482.jpg already downloaded
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F7043275bfaad53001b9c080237da7ac9%252Fpa%252FXY44449_aa163958fedc059dbe3abd8752db0c8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_aa163958fedc059dbe3abd8752db0c8c.jpg already downloaded
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F7043275bfaad53001b9c080237da7ac9%252Fpa%252FXY44449_95c675f7dfca261a321b5e260dd49c97.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_95c675f7dfca261a321b5e260dd49c97.jpg already downloaded
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F7043275bfaad53001b9c080237da7ac9%252Fpa%252FXY44449_a2d87d79d4777cbdab216492a1c69f8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_a2d87d79d4777cbdab216492a1c69f8f.jpg already downloaded
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F7043275bfaad53001b9c080237da7ac9%252Fpa%252FXY44449_4ae72017ac41a248d327d34ebdc7d085.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_4ae72017ac41a248d327d34ebdc7d085.jpg already downloaded
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F7043275bfaad53001b9c080237da7ac9%252Fpa%252FXY44449_0a7545a5a4ed333f2863689314349468.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_0a7545a5a4ed333f2863689314349468.jpg already downloaded
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F7043275bfaad53001b9c080237da7ac9%252Fpa%252FXY44449_7c1c9598627d5ab3d9e2f53a8a1b03ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_7c1c9598627d5ab3d9e2f53a8a1b03ce.jpg already downloaded
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F7043275bfaad53001b9c080237da7ac9%252Fpa%252FXY44449_d1a803a30d6f314d152bedfce8e36fbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_d1a803a30d6f314d152bedfce8e36fbd.jpg already downloaded
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F7043275bfaad53001b9c080237da7ac9%252Fpa%252FXY44449_873bd388fb75b34178e070c1728bae15.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_873bd388fb75b34178e070c1728bae15.jpg already downloaded
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F7043275bfaad53001b9c080237da7ac9%252Fpa%252FXY44449_2ae390f03d114f21f98d76769c3ce6e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_2ae390f03d114f21f98d76769c3ce6e4.jpg already downloaded
2026-03-30 08:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eab36051-05b6-5133-8ea3-974f913fe1e8, identifier: XY44449
2026-03-30 08:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c931f590>
2026-03-30 08:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fac%252Fceac1ec5f5d25565083e0e576674e8ec%252Fpa%252FNL96046_6d789b0484d551b01924044e52cf53cc.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_6d789b0484d551b01924044e52cf53cc.jpg saved to cache
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0889cab-78aa-527c-b0dc-43821d2df211
2026-03-30 08:31:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0889cab-78aa-527c-b0dc-43821d2df211, skipping ID generation
2026-03-30 08:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0889cab-78aa-527c-b0dc-43821d2df211 with scrape type 1
2026-03-30 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0889cab-78aa-527c-b0dc-43821d2df211 sending to next pipeline
2026-03-30 08:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e0889cab-78aa-527c-b0dc-43821d2df211, identifier: NL96046
2026-03-30 08:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9 with identifier: ZV23610
2026-03-30 08:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9 with scrape type 1
2026-03-30 08:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_4da5a53cb024ced10a105f1fb41236b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_4da5a53cb024ced10a105f1fb41236b0.jpg not downloaded yet
2026-03-30 08:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_9227d992897ab54f89ff5f232c4805eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:18 [auto1.be] INFO: Found listing with ID: PH13121
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH13121%27 HTTP/1.1" 200 None
2026-03-30 08:31:18 [auto1.be] INFO: Scrape type for PH13121: 1
2026-03-30 08:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eab36051-05b6-5133-8ea3-974f913fe1e8 with identifier: XY44449
2026-03-30 08:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eab36051-05b6-5133-8ea3-974f913fe1e8 with identifier: XY44449
2026-03-30 08:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eab36051-05b6-5133-8ea3-974f913fe1e8 with identifier: XY44449 to the API
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XY44449>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 212,
 'expiration_date': '2026-03-31T15:43:02Z',
 'fuel_type': 'diesel',
 'id': 'eab36051-05b6-5133-8ea3-974f913fe1e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY44449',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 114664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_c14ed94aa84af1ca7a98ba55e08c0482.jpg',
                'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_aa163958fedc059dbe3abd8752db0c8c.jpg',
                'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_95c675f7dfca261a321b5e260dd49c97.jpg',
                'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_a2d87d79d4777cbdab216492a1c69f8f.jpg',
                'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_4ae72017ac41a248d327d34ebdc7d085.jpg',
                'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_0a7545a5a4ed333f2863689314349468.jpg',
                'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_7c1c9598627d5ab3d9e2f53a8a1b03ce.jpg',
                'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_d1a803a30d6f314d152bedfce8e36fbd.jpg',
                'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_873bd388fb75b34178e070c1728bae15.jpg',
                'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_2ae390f03d114f21f98d76769c3ce6e4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eab36051-05b6-5133-8ea3-974f913fe1e8/eab36051-05b6-5133-8ea3-974f913fe1e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2418573,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_c14ed94aa84af1ca7a98ba55e08c0482.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eab36051-05b6-5133-8ea3-974f913fe1e8/eab36051-05b6-5133-8ea3-974f913fe1e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2486635,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_aa163958fedc059dbe3abd8752db0c8c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eab36051-05b6-5133-8ea3-974f913fe1e8/eab36051-05b6-5133-8ea3-974f913fe1e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2702962,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_95c675f7dfca261a321b5e260dd49c97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eab36051-05b6-5133-8ea3-974f913fe1e8/eab36051-05b6-5133-8ea3-974f913fe1e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2372759,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_a2d87d79d4777cbdab216492a1c69f8f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eab36051-05b6-5133-8ea3-974f913fe1e8/eab36051-05b6-5133-8ea3-974f913fe1e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2471637,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_4ae72017ac41a248d327d34ebdc7d085.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eab36051-05b6-5133-8ea3-974f913fe1e8/eab36051-05b6-5133-8ea3-974f913fe1e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_0a7545a5a4ed333f2863689314349468.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eab36051-05b6-5133-8ea3-974f913fe1e8/eab36051-05b6-5133-8ea3-974f913fe1e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2497568,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_7c1c9598627d5ab3d9e2f53a8a1b03ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eab36051-05b6-5133-8ea3-974f913fe1e8/eab36051-05b6-5133-8ea3-974f913fe1e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_d1a803a30d6f314d152bedfce8e36fbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eab36051-05b6-5133-8ea3-974f913fe1e8/eab36051-05b6-5133-8ea3-974f913fe1e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463058,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_873bd388fb75b34178e070c1728bae15.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eab36051-05b6-5133-8ea3-974f913fe1e8/eab36051-05b6-5133-8ea3-974f913fe1e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2759619,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/7043275bfaad53001b9c080237da7ac9/pa/XY44449_2ae390f03d114f21f98d76769c3ce6e4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2020}
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY44449%27 HTTP/1.1" 200 None
2026-03-30 08:31:18 [auto1.be] INFO: Saving data for XY44449: {'created_time': 1774859478.397372, 'last_price_update_time': 1774859478.397385, 'auction_closing_time': 1774971782.0}
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XY44449') HTTP/1.1" 204 0
2026-03-30 08:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e0889cab-78aa-527c-b0dc-43821d2df211 with identifier: NL96046
2026-03-30 08:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e0889cab-78aa-527c-b0dc-43821d2df211 with identifier: NL96046
2026-03-30 08:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e0889cab-78aa-527c-b0dc-43821d2df211 with identifier: NL96046 to the API
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_6d789b0484d551b01924044e52cf53cc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.3L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:01:02Z',
 'fuel_type': 'petrol',
 'id': 'e0889cab-78aa-527c-b0dc-43821d2df211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL96046',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 128167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_a9163dfe20cebd81afab1cd1c69a5b87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_790bb7d0d1953560f68b2dbf03011313.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_6376390b0655476b51df4bd1fa7f0961.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_6d789b0484d551b01924044e52cf53cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_485ed94fa9c002c51a6f512d29a80339.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_ecc2fcf5795058acba5a11b3ed59292c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_d56d5cb843483f5b8e57103b1d495edb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_d0440e1012516bcdf5ac68528d4cccd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_73f5cf872b4817dc4c43e49c899263b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0889cab-78aa-527c-b0dc-43821d2df211/e0889cab-78aa-527c-b0dc-43821d2df211_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ac/ceac1ec5f5d25565083e0e576674e8ec/pa/NL96046_054f11a6bd354d2f4ceec3662cf8b211.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2010}
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL96046%27 HTTP/1.1" 200 None
2026-03-30 08:31:18 [auto1.be] INFO: Saving data for NL96046: {'created_time': 1774859478.780901, 'last_price_update_time': 1774859478.780913, 'auction_closing_time': 1774969262.0}
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NL96046') HTTP/1.1" 204 0
2026-03-30 08:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_68e98553930cea71a4df582e6b7e93c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_61230a106caaed0b108e203270b62e21.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_61230a106caaed0b108e203270b62e21.jpg not downloaded yet
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_77d22838b4bf24f1513fd4b7e4a342e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_77d22838b4bf24f1513fd4b7e4a342e8.jpg not downloaded yet
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_b48da29b6dcb9cc3e526a76c54711e46.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_b48da29b6dcb9cc3e526a76c54711e46.jpg not downloaded yet
2026-03-30 08:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c94338d0>
2026-03-30 08:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_452b235847678eb2aaa78ae1c68036b8.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_452b235847678eb2aaa78ae1c68036b8.jpg saved to cache
2026-03-30 08:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a740f60-629c-5dfd-a0c4-f760f6169e45
2026-03-30 08:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c94bdbd0>
2026-03-30 08:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_64b4b2c759d8bfad4ac50fc742e4a576.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_64b4b2c759d8bfad4ac50fc742e4a576.jpg saved to cache
2026-03-30 08:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9
2026-03-30 08:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c942c810>
2026-03-30 08:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_f5a079359b645aa295ae0b5a1a3a4db3.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_f5a079359b645aa295ae0b5a1a3a4db3.jpg saved to cache
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9
2026-03-30 08:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_42b2b42cf1bc0926bc60c802f3564d55.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_b5a10072364cb67f227e668032a804f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:19 [auto1.be] INFO: Found listing with ID: EF47293
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF47293%27 HTTP/1.1" 200 None
2026-03-30 08:31:19 [auto1.be] INFO: Scrape type for EF47293: 1
2026-03-30 08:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC80115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_0f4f4d85f196621ff2b9675af9a7b160.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_0f4f4d85f196621ff2b9675af9a7b160.jpg not downloaded yet
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_02a636fbc5f7ec450222f9587c5177d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_02a636fbc5f7ec450222f9587c5177d5.jpg not downloaded yet
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_64c5f54018adbe912d33affd7acc33f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_64c5f54018adbe912d33affd7acc33f0.jpg not downloaded yet
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9392090>
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_9227d992897ab54f89ff5f232c4805eb.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_9227d992897ab54f89ff5f232c4805eb.jpg saved to cache
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a740f60-629c-5dfd-a0c4-f760f6169e45
2026-03-30 08:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_5126fffadc3e6d4a4696e5670a44532a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:19 [auto1.be] INFO: Found listing with ID: GG54325
2026-03-30 08:31:19 [auto1.be] INFO: Found listing with ID: BH83667
2026-03-30 08:31:19 [auto1.be] INFO: Found listing with ID: DA89043
2026-03-30 08:31:19 [auto1.be] INFO: Found listing with ID: AE99564
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE99564%27 HTTP/1.1" 200 None
2026-03-30 08:31:19 [auto1.be] INFO: Scrape type for AE99564: 1
2026-03-30 08:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_db1e8cde27c8f6b42233d77b3d2ff92b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_18082e8da59ce703ab1ef8e7f81205dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_18082e8da59ce703ab1ef8e7f81205dc.jpg not downloaded yet
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_acec55e09ed55cb844223feda6c5c042.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_acec55e09ed55cb844223feda6c5c042.jpg not downloaded yet
2026-03-30 08:31:19 [auto1.be] INFO: Found listing with ID: BC23498
2026-03-30 08:31:19 [auto1.be] INFO: Found listing with ID: VP07407
2026-03-30 08:31:19 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS12124%27 HTTP/1.1" 200 None
2026-03-30 08:31:19 [auto1.be] INFO: Scrape type for TS12124: 2
2026-03-30 08:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b3df74f-76c7-5027-9fd8-5f6326bc6e04 with identifier: TS12124
2026-03-30 08:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b3df74f-76c7-5027-9fd8-5f6326bc6e04 with scrape type 2
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b3df74f-76c7-5027-9fd8-5f6326bc6e04 with scrape type 2
2026-03-30 08:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b3df74f-76c7-5027-9fd8-5f6326bc6e04, identifier: TS12124
2026-03-30 08:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c93928d0>
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_68e98553930cea71a4df582e6b7e93c2.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_68e98553930cea71a4df582e6b7e93c2.jpg saved to cache
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a740f60-629c-5dfd-a0c4-f760f6169e45
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c942c390>
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fee%252Ff9ee4ef3781820f1d9813524cf4d4872%252Fpa%252FEU38310_42b2b42cf1bc0926bc60c802f3564d55.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_42b2b42cf1bc0926bc60c802f3564d55.jpg saved to cache
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9
2026-03-30 08:31:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 614f279e-472a-5f3c-b3e5-fb33b302e2b9, skipping ID generation
2026-03-30 08:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9 with scrape type 1
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 614f279e-472a-5f3c-b3e5-fb33b302e2b9 sending to next pipeline
2026-03-30 08:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 614f279e-472a-5f3c-b3e5-fb33b302e2b9, identifier: EU38310
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c96124d0>
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_b5a10072364cb67f227e668032a804f8.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_b5a10072364cb67f227e668032a804f8.jpg saved to cache
2026-03-30 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4
2026-03-30 08:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b3df74f-76c7-5027-9fd8-5f6326bc6e04 with identifier: TS12124
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 08:31:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b3df74f-76c7-5027-9fd8-5f6326bc6e04 with identifier: TS12124
2026-03-30 08:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b3df74f-76c7-5027-9fd8-5f6326bc6e04 with identifier: TS12124 to the API
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:03:53Z',
 'fuel_type': 'diesel',
 'id': '9b3df74f-76c7-5027-9fd8-5f6326bc6e04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS12124',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 207156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-27',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 e-HDi XTR',
 'transmission': 'automatic',
 'trim': 'XTR',
 'year': 2014}
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS12124%27 HTTP/1.1" 200 None
2026-03-30 08:31:20 [auto1.be] INFO: Saving data for TS12124: {'auction_closing_time': 1774969433.0, 'created_time': 1773131744.964197, 'last_price_update_time': 1774859480.059626}
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS12124') HTTP/1.1" 204 0
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_58a0270f5d9c888abe39574f3ce6cf44.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_58a0270f5d9c888abe39574f3ce6cf44.jpg not downloaded yet
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_7a50f3968ac47a2b86d64e06446020a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_7a50f3968ac47a2b86d64e06446020a1.jpg not downloaded yet
2026-03-30 08:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 614f279e-472a-5f3c-b3e5-fb33b302e2b9 with identifier: EU38310
2026-03-30 08:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 614f279e-472a-5f3c-b3e5-fb33b302e2b9 with identifier: EU38310
2026-03-30 08:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 614f279e-472a-5f3c-b3e5-fb33b302e2b9 with identifier: EU38310 to the API
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_42b2b42cf1bc0926bc60c802f3564d55.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:16:12Z',
 'fuel_type': 'diesel',
 'id': '614f279e-472a-5f3c-b3e5-fb33b302e2b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU38310',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 147203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_97f48d78761ce67be94d1210e95a0af6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_42b2b42cf1bc0926bc60c802f3564d55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_95072e045e440d484a6fd8a993b89db5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_f5a079359b645aa295ae0b5a1a3a4db3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_e91bd2338ee4300652d3e9552e9110d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_64b4b2c759d8bfad4ac50fc742e4a576.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_9729204b992502239e890bbec443b670.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_26c24aa6a5562173c9c61f670c688b01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_4b8b3838b89f184d2fa44276186646e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614f279e-472a-5f3c-b3e5-fb33b302e2b9/614f279e-472a-5f3c-b3e5-fb33b302e2b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/ee/f9ee4ef3781820f1d9813524cf4d4872/pa/EU38310_4b0d44824f10ed71164ccc5fb7d15347.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.8 DI-D Intense 4WD',
 'transmission': 'manual',
 'trim': 'Intense 4WD',
 'year': 2013}
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU38310%27 HTTP/1.1" 200 None
2026-03-30 08:31:20 [auto1.be] INFO: Saving data for EU38310: {'created_time': 1774859480.5842, 'last_price_update_time': 1774859480.584213, 'auction_closing_time': 1774970172.0}
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EU38310') HTTP/1.1" 204 0
2026-03-30 08:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_530195a2b134c2aff2b56fde46c21e42.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_4da5a53cb024ced10a105f1fb41236b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:20 [auto1.be] INFO: Found listing with ID: JY99068
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY99068%27 HTTP/1.1" 200 None
2026-03-30 08:31:20 [auto1.be] INFO: Scrape type for JY99068: 1
2026-03-30 08:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_3e0296ec37a2b8dc9d82a6066d0bade7.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_509ea976703f75f64086828925af3944.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_1237cf624e531eaa51913357e20620aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_f629d57d145499d87b1ac024e250f92e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_f629d57d145499d87b1ac024e250f92e.jpg not downloaded yet
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_c7efb9d387f6d0ad31d0644b5fa79101.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_c7efb9d387f6d0ad31d0644b5fa79101.jpg not downloaded yet
2026-03-30 08:31:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c94f5810>
2026-03-30 08:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_5126fffadc3e6d4a4696e5670a44532a.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_5126fffadc3e6d4a4696e5670a44532a.jpg saved to cache
2026-03-30 08:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6946a55a-bc5a-53be-967f-97023b11bd7e
2026-03-30 08:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca62ff90>
2026-03-30 08:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_db1e8cde27c8f6b42233d77b3d2ff92b.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_db1e8cde27c8f6b42233d77b3d2ff92b.jpg saved to cache
2026-03-30 08:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a740f60-629c-5dfd-a0c4-f760f6169e45
2026-03-30 08:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_77d22838b4bf24f1513fd4b7e4a342e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:20 [auto1.be] INFO: Found listing with ID: JC64183
2026-03-30 08:31:20 [auto1.be] INFO: Found listing with ID: LJ62513
2026-03-30 08:31:20 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-30 08:31:20 [auto1.be] INFO: Found listing with ID: UY40990
2026-03-30 08:31:20 [auto1.be] INFO: Found listing with ID: CM92821
2026-03-30 08:31:20 [auto1.be] INFO: Found listing with ID: HM28534
2026-03-30 08:31:20 [auto1.be] INFO: Found listing with ID: TL00014
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL00014%27 HTTP/1.1" 200 None
2026-03-30 08:31:20 [auto1.be] INFO: Scrape type for TL00014: 1
2026-03-30 08:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH39924> (referer: https://www.auto1.com/v1/car-details-view/RH39924/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ16156/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_784009ad3865a1e2eecdab75dc86e417.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_784009ad3865a1e2eecdab75dc86e417.jpg not downloaded yet
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_098ce00f52606d0a951c3b355f47e4f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_098ce00f52606d0a951c3b355f47e4f8.jpg not downloaded yet
2026-03-30 08:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_61230a106caaed0b108e203270b62e21.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:20 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-30 08:31:20 [auto1.be] INFO: Found listing with ID: YW02361
2026-03-30 08:31:20 [auto1.be] INFO: Found listing with ID: BC43211
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC43211%27 HTTP/1.1" 200 None
2026-03-30 08:31:20 [auto1.be] INFO: Scrape type for BC43211: 2
2026-03-30 08:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a44f5537-0906-5521-9d45-13eb657c7857 with identifier: BC43211
2026-03-30 08:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a44f5537-0906-5521-9d45-13eb657c7857 with scrape type 2
2026-03-30 08:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a44f5537-0906-5521-9d45-13eb657c7857 with scrape type 2
2026-03-30 08:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a44f5537-0906-5521-9d45-13eb657c7857, identifier: BC43211
2026-03-30 08:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a44f5537-0906-5521-9d45-13eb657c7857 with identifier: BC43211
2026-03-30 08:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a44f5537-0906-5521-9d45-13eb657c7857 with identifier: BC43211
2026-03-30 08:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a44f5537-0906-5521-9d45-13eb657c7857 with identifier: BC43211 to the API
2026-03-30 08:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:22:49Z',
 'fuel_type': 'petrol',
 'id': 'a44f5537-0906-5521-9d45-13eb657c7857',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC43211',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 129724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-05',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2014}
2026-03-30 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC43211%27 HTTP/1.1" 200 None
2026-03-30 08:31:21 [auto1.be] INFO: Saving data for BC43211: {'auction_closing_time': 1774970569.0, 'created_time': 1774298087.403521, 'last_price_update_time': 1774859481.782839}
2026-03-30 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC43211') HTTP/1.1" 204 0
2026-03-30 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_7a6ffe488ac15dbb728d654ad0ce93f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_7a6ffe488ac15dbb728d654ad0ce93f0.jpg not downloaded yet
2026-03-30 08:31:21 [auto1.be] INFO: Found listing with ID: JD88445
2026-03-30 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD88445%27 HTTP/1.1" 200 None
2026-03-30 08:31:22 [auto1.be] INFO: Scrape type for JD88445: 1
2026-03-30 08:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH91226> (referer: https://www.auto1.com/v1/car-details-view/NH91226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9392510>
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_530195a2b134c2aff2b56fde46c21e42.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_530195a2b134c2aff2b56fde46c21e42.jpg saved to cache
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6946a55a-bc5a-53be-967f-97023b11bd7e
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca650fd0>
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_4da5a53cb024ced10a105f1fb41236b0.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_4da5a53cb024ced10a105f1fb41236b0.jpg saved to cache
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9
2026-03-30 08:31:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c93dc6d0>
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_3e0296ec37a2b8dc9d82a6066d0bade7.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_3e0296ec37a2b8dc9d82a6066d0bade7.jpg saved to cache
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6946a55a-bc5a-53be-967f-97023b11bd7e
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9442450>
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_509ea976703f75f64086828925af3944.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_509ea976703f75f64086828925af3944.jpg saved to cache
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c954c810>
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_1237cf624e531eaa51913357e20620aa.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_1237cf624e531eaa51913357e20620aa.jpg saved to cache
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_880588fbcf2d443ec0dc93b310b3334d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_880588fbcf2d443ec0dc93b310b3334d.jpg not downloaded yet
2026-03-30 08:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK81975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF47293/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE99564/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_3cb4ba6d584e27477898ae72ed18df04.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:22 [auto1.be] INFO: Found listing with ID: HH39749
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH39749%27 HTTP/1.1" 200 None
2026-03-30 08:31:22 [auto1.be] INFO: Scrape type for HH39749: 2
2026-03-30 08:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95cc8cfd-bb3e-5891-8914-58275cdb555b with identifier: HH39749
2026-03-30 08:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95cc8cfd-bb3e-5891-8914-58275cdb555b with scrape type 2
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95cc8cfd-bb3e-5891-8914-58275cdb555b with scrape type 2
2026-03-30 08:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 95cc8cfd-bb3e-5891-8914-58275cdb555b, identifier: HH39749
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca653250>
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_77d22838b4bf24f1513fd4b7e4a342e8.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_77d22838b4bf24f1513fd4b7e4a342e8.jpg saved to cache
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4
2026-03-30 08:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e16c549f-c68b-593c-887b-d1f47a4cba88 with identifier: RH39924
2026-03-30 08:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e16c549f-c68b-593c-887b-d1f47a4cba88 with scrape type 1
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e16c549f-c68b-593c-887b-d1f47a4cba88
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_902c14dc1ecaebc72c7183b6703c5449.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_902c14dc1ecaebc72c7183b6703c5449.jpg not downloaded yet
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c94e2790>
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_61230a106caaed0b108e203270b62e21.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_61230a106caaed0b108e203270b62e21.jpg saved to cache
2026-03-30 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0a740f60-629c-5dfd-a0c4-f760f6169e45
2026-03-30 08:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 95cc8cfd-bb3e-5891-8914-58275cdb555b with identifier: HH39749
2026-03-30 08:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 95cc8cfd-bb3e-5891-8914-58275cdb555b with identifier: HH39749
2026-03-30 08:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 95cc8cfd-bb3e-5891-8914-58275cdb555b with identifier: HH39749 to the API
2026-03-30 08:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:14:11Z',
 'fuel_type': 'diesel',
 'id': '95cc8cfd-bb3e-5891-8914-58275cdb555b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH39749',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 49449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-07',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2019}
2026-03-30 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH39749%27 HTTP/1.1" 200 None
2026-03-30 08:31:23 [auto1.be] INFO: Saving data for HH39749: {'auction_closing_time': 1774970051.0, 'created_time': 1773434318.944326, 'last_price_update_time': 1774859483.127257}
2026-03-30 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HH39749') HTTP/1.1" 204 0
2026-03-30 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_a138726e782a851003c3d043e23ef931.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_a138726e782a851003c3d043e23ef931.jpg not downloaded yet
2026-03-30 08:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f67b2a-f640-595a-bd30-f8ade4a1878d with identifier: NH91226
2026-03-30 08:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f67b2a-f640-595a-bd30-f8ade4a1878d with scrape type 1
2026-03-30 08:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7f67b2a-f640-595a-bd30-f8ade4a1878d
2026-03-30 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_f7fa95a5441ae76a9232c5a06bd74d5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_f7fa95a5441ae76a9232c5a06bd74d5d.jpg not downloaded yet
2026-03-30 08:31:23 [auto1.be] INFO: Found listing with ID: WY71149
2026-03-30 08:31:23 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-30 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA69116%27 HTTP/1.1" 200 None
2026-03-30 08:31:23 [auto1.be] INFO: Scrape type for YA69116: 2
2026-03-30 08:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de with identifier: YA69116
2026-03-30 08:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de with scrape type 2
2026-03-30 08:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de with scrape type 2
2026-03-30 08:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de, identifier: YA69116
2026-03-30 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_79105ee5ecc93ebca5fca4807addedaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_79105ee5ecc93ebca5fca4807addedaf.jpg not downloaded yet
2026-03-30 08:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de with identifier: YA69116
2026-03-30 08:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de with identifier: YA69116
2026-03-30 08:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c5614c2-f10e-5a01-bd9e-46caaaa6d6de with identifier: YA69116 to the API
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:20:11Z',
 'fuel_type': 'diesel',
 'id': '9c5614c2-f10e-5a01-bd9e-46caaaa6d6de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA69116',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 217826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-16',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2019}
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA69116%27 HTTP/1.1" 200 None
2026-03-30 08:31:24 [auto1.be] INFO: Saving data for YA69116: {'auction_closing_time': 1774970411.0, 'created_time': 1774438328.277793, 'last_price_update_time': 1774859484.484862}
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA69116') HTTP/1.1" 204 0
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_8dcbfd7faa8748d6e84092614138ddc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_8dcbfd7faa8748d6e84092614138ddc8.jpg not downloaded yet
2026-03-30 08:31:24 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1492 | hits on page: 40
2026-03-30 08:31:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7821d0>
2026-03-30 08:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F63%252Fd26396d49f8addfdb353166f7bc16b86%252Fpa%252FEW88607_3cb4ba6d584e27477898ae72ed18df04.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_3cb4ba6d584e27477898ae72ed18df04.jpg saved to cache
2026-03-30 08:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6946a55a-bc5a-53be-967f-97023b11bd7e
2026-03-30 08:31:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6946a55a-bc5a-53be-967f-97023b11bd7e, skipping ID generation
2026-03-30 08:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6946a55a-bc5a-53be-967f-97023b11bd7e with scrape type 1
2026-03-30 08:31:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6946a55a-bc5a-53be-967f-97023b11bd7e sending to next pipeline
2026-03-30 08:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6946a55a-bc5a-53be-967f-97023b11bd7e, identifier: EW88607
2026-03-30 08:31:24 [auto1.be] INFO: Found listing with ID: DJ79108
2026-03-30 08:31:24 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-30 08:31:24 [auto1.be] INFO: Found listing with ID: ER70694
2026-03-30 08:31:24 [auto1.be] INFO: Found listing with ID: UK31480
2026-03-30 08:31:24 [auto1.be] INFO: Found listing with ID: CN63024
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN63024%27 HTTP/1.1" 200 None
2026-03-30 08:31:24 [auto1.be] INFO: Scrape type for CN63024: 1
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_1b36ab2ccac194716483d8a1eef89815.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_1b36ab2ccac194716483d8a1eef89815.jpg not downloaded yet
2026-03-30 08:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6946a55a-bc5a-53be-967f-97023b11bd7e with identifier: EW88607
2026-03-30 08:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6946a55a-bc5a-53be-967f-97023b11bd7e with identifier: EW88607
2026-03-30 08:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6946a55a-bc5a-53be-967f-97023b11bd7e with identifier: EW88607 to the API
2026-03-30 08:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_3cb4ba6d584e27477898ae72ed18df04.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:11:58Z',
 'fuel_type': 'petrol',
 'id': '6946a55a-bc5a-53be-967f-97023b11bd7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW88607',
 'listing': 'auction',
 'location': 'BE, Seraing',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 82016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_0237cf35924c0e9240a780009b5ad7e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3250354,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_5126fffadc3e6d4a4696e5670a44532a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3347697,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_530195a2b134c2aff2b56fde46c21e42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3273778,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_3e0296ec37a2b8dc9d82a6066d0bade7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_98c6d49afacdd91a8fe7ae689d0c20d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_481d15992cbb8ef1614d4a086fa475c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_cf6a5e0fa128166e3cd27d665928b9c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3145815,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_3cb4ba6d584e27477898ae72ed18df04.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_f6af858219ef35ae0a0b31b2836c7561.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6946a55a-bc5a-53be-967f-97023b11bd7e/6946a55a-bc5a-53be-967f-97023b11bd7e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/63/d26396d49f8addfdb353166f7bc16b86/pa/EW88607_aa99eef8937559743401d2767ad2f932.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2020}
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW88607%27 HTTP/1.1" 200 None
2026-03-30 08:31:25 [auto1.be] INFO: Saving data for EW88607: {'created_time': 1774859485.183835, 'last_price_update_time': 1774859485.183845, 'auction_closing_time': 1774969918.0}
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EW88607') HTTP/1.1" 204 0
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_c286e8a3798fb267bf59598e94ec5b79.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_c286e8a3798fb267bf59598e94ec5b79.jpg not downloaded yet
2026-03-30 08:31:25 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-30 08:31:25 [auto1.be] INFO: Found listing with ID: VK40214
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK40214%27 HTTP/1.1" 200 None
2026-03-30 08:31:25 [auto1.be] INFO: Scrape type for VK40214: 1
2026-03-30 08:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_f629d57d145499d87b1ac024e250f92e.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_098ce00f52606d0a951c3b355f47e4f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_880588fbcf2d443ec0dc93b310b3334d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_784009ad3865a1e2eecdab75dc86e417.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_c7efb9d387f6d0ad31d0644b5fa79101.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:25 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-30 08:31:25 [auto1.be] INFO: Found listing with ID: EB13238
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB13238%27 HTTP/1.1" 200 None
2026-03-30 08:31:25 [auto1.be] INFO: Scrape type for EB13238: 2
2026-03-30 08:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94a2bcc8-54e9-57d2-aacd-c0c02db23357 with identifier: EB13238
2026-03-30 08:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a2bcc8-54e9-57d2-aacd-c0c02db23357 with scrape type 2
2026-03-30 08:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94a2bcc8-54e9-57d2-aacd-c0c02db23357 with scrape type 2
2026-03-30 08:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94a2bcc8-54e9-57d2-aacd-c0c02db23357, identifier: EB13238
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_60436cd1c30e863ddf0957fda2db9f8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_60436cd1c30e863ddf0957fda2db9f8f.jpg not downloaded yet
2026-03-30 08:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94a2bcc8-54e9-57d2-aacd-c0c02db23357 with identifier: EB13238
2026-03-30 08:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94a2bcc8-54e9-57d2-aacd-c0c02db23357 with identifier: EB13238
2026-03-30 08:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94a2bcc8-54e9-57d2-aacd-c0c02db23357 with identifier: EB13238 to the API
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:51:12Z',
 'fuel_type': 'diesel',
 'id': '94a2bcc8-54e9-57d2-aacd-c0c02db23357',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB13238',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 218800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-10',
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Highline DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline DoubleCab 4Motion',
 'year': 2020}
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB13238%27 HTTP/1.1" 200 None
2026-03-30 08:31:25 [auto1.be] INFO: Saving data for EB13238: {'auction_closing_time': 1774972272.0, 'created_time': 1773136475.953813, 'last_price_update_time': 1774859485.895266}
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EB13238') HTTP/1.1" 204 0
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_f33d4dfdf24d904d71c37349fc3363e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_f33d4dfdf24d904d71c37349fc3363e4.jpg not downloaded yet
2026-03-30 08:31:26 [auto1.be] INFO: Found listing with ID: KM41856
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM41856%27 HTTP/1.1" 200 None
2026-03-30 08:31:26 [auto1.be] INFO: Scrape type for KM41856: 2
2026-03-30 08:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 646ecf2c-8e38-543e-b8dd-171b83f9d32b with identifier: KM41856
2026-03-30 08:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 646ecf2c-8e38-543e-b8dd-171b83f9d32b with scrape type 2
2026-03-30 08:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 646ecf2c-8e38-543e-b8dd-171b83f9d32b with scrape type 2
2026-03-30 08:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 646ecf2c-8e38-543e-b8dd-171b83f9d32b, identifier: KM41856
2026-03-30 08:31:26 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU54459%27 HTTP/1.1" 200 None
2026-03-30 08:31:26 [auto1.be] INFO: Scrape type for YU54459: 2
2026-03-30 08:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ada367ff-1056-592d-995a-8db30181397b with identifier: YU54459
2026-03-30 08:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ada367ff-1056-592d-995a-8db30181397b with scrape type 2
2026-03-30 08:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ada367ff-1056-592d-995a-8db30181397b with scrape type 2
2026-03-30 08:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ada367ff-1056-592d-995a-8db30181397b, identifier: YU54459
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_5a26e2a329396b7ab31fa533224872a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_5a26e2a329396b7ab31fa533224872a6.jpg not downloaded yet
2026-03-30 08:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 646ecf2c-8e38-543e-b8dd-171b83f9d32b with identifier: KM41856
2026-03-30 08:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 646ecf2c-8e38-543e-b8dd-171b83f9d32b with identifier: KM41856
2026-03-30 08:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 646ecf2c-8e38-543e-b8dd-171b83f9d32b with identifier: KM41856 to the API
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:44:59Z',
 'fuel_type': 'diesel',
 'id': '646ecf2c-8e38-543e-b8dd-171b83f9d32b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM41856',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 190497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-04',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2018}
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM41856%27 HTTP/1.1" 200 None
2026-03-30 08:31:26 [auto1.be] INFO: Saving data for KM41856: {'auction_closing_time': 1774971899.0, 'created_time': 1774557224.923922, 'last_price_update_time': 1774859486.64939}
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KM41856') HTTP/1.1" 204 0
2026-03-30 08:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ada367ff-1056-592d-995a-8db30181397b with identifier: YU54459
2026-03-30 08:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ada367ff-1056-592d-995a-8db30181397b with identifier: YU54459
2026-03-30 08:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ada367ff-1056-592d-995a-8db30181397b with identifier: YU54459 to the API
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:51:28Z',
 'fuel_type': 'hybrid',
 'id': 'ada367ff-1056-592d-995a-8db30181397b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU54459',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 89759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-27',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU54459%27 HTTP/1.1" 200 None
2026-03-30 08:31:26 [auto1.be] INFO: Saving data for YU54459: {'auction_closing_time': 1774972288.0, 'created_time': 1773747599.32111, 'last_price_update_time': 1774859486.989247}
2026-03-30 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YU54459') HTTP/1.1" 204 0
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_89ff62038c07488f3a10a5935ee18a65.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_89ff62038c07488f3a10a5935ee18a65.jpg not downloaded yet
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: FG04950
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG04950%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for FG04950: 1
2026-03-30 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_58a0270f5d9c888abe39574f3ce6cf44.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_acec55e09ed55cb844223feda6c5c042.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_64c5f54018adbe912d33affd7acc33f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_18082e8da59ce703ab1ef8e7f81205dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: NS58610
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_7e8dd2051514f64e049d8664ab7fb7e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_7e8dd2051514f64e049d8664ab7fb7e2.jpg not downloaded yet
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca6ba4d0>
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_f629d57d145499d87b1ac024e250f92e.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_f629d57d145499d87b1ac024e250f92e.jpg saved to cache
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ccb5d990>
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_098ce00f52606d0a951c3b355f47e4f8.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_098ce00f52606d0a951c3b355f47e4f8.jpg saved to cache
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9611290>
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_880588fbcf2d443ec0dc93b310b3334d.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_880588fbcf2d443ec0dc93b310b3334d.jpg saved to cache
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9516810>
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_784009ad3865a1e2eecdab75dc86e417.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_784009ad3865a1e2eecdab75dc86e417.jpg saved to cache
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9458090>
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_c7efb9d387f6d0ad31d0644b5fa79101.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_c7efb9d387f6d0ad31d0644b5fa79101.jpg saved to cache
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9
2026-03-30 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_1b36ab2ccac194716483d8a1eef89815.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_2855fd0621c6e095f83f8ad767222a1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_2855fd0621c6e095f83f8ad767222a1f.jpg not downloaded yet
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: SR54305
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: HM64227
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: YN29778
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN29778%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for YN29778: 0
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP75874%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for VP75874: 0
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: MJ73226
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU19738%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for SU19738: 0
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: KX00210
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX00210%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for KX00210: 0
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE06051%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for PE06051: 0
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: VR76359
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR76359%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for VR76359: 0
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: GS35098
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: BS14605
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: ZC01857
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC01857%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for ZC01857: 0
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT59149%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for HT59149: 0
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: JN20180
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: XG78085
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: VX47829
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: JV43445
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV43445%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for JV43445: 0
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: GK69232
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: FJ11174
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: YP46156
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP46156%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for YP46156: 0
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: KD38906
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD38906%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for KD38906: 0
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: DG03200
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG03200%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for DG03200: 0
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: CH88253
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: TY37950
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: KD13812
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: WN92129
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: VW53084
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW53084%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [auto1.be] INFO: Scrape type for VW53084: 0
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-30 08:31:27 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_fbe1b8f1fee1238462382fe3a908f7b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_fbe1b8f1fee1238462382fe3a908f7b1.jpg not downloaded yet
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_bf6942d22c520b1c2e9606905a1020d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_bf6942d22c520b1c2e9606905a1020d2.jpg not downloaded yet
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca8bf150>
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_58a0270f5d9c888abe39574f3ce6cf44.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_58a0270f5d9c888abe39574f3ce6cf44.jpg saved to cache
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca636490>
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_acec55e09ed55cb844223feda6c5c042.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_acec55e09ed55cb844223feda6c5c042.jpg saved to cache
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9555a10>
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_64c5f54018adbe912d33affd7acc33f0.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_64c5f54018adbe912d33affd7acc33f0.jpg saved to cache
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca636010>
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_18082e8da59ce703ab1ef8e7f81205dc.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_18082e8da59ce703ab1ef8e7f81205dc.jpg saved to cache
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_7477bc6dd25ade678fe9dae314c83c1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_7477bc6dd25ade678fe9dae314c83c1c.jpg not downloaded yet
2026-03-30 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_60436cd1c30e863ddf0957fda2db9f8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_898a8d27748f811840fff0b32c01e66c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_898a8d27748f811840fff0b32c01e66c.jpg not downloaded yet
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_561123e55d7b57adf857239bfb002a33.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_561123e55d7b57adf857239bfb002a33.jpg not downloaded yet
2026-03-30 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD88445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c931f7d0>
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_1b36ab2ccac194716483d8a1eef89815.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_1b36ab2ccac194716483d8a1eef89815.jpg saved to cache
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e16c549f-c68b-593c-887b-d1f47a4cba88
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_27719647668987279181ed8210b87cd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_27719647668987279181ed8210b87cd2.jpg not downloaded yet
2026-03-30 08:31:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_536510e5c2d63482ff1c51b7b8638449.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_536510e5c2d63482ff1c51b7b8638449.jpg not downloaded yet
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_d0fb1beb273e1d6c43e8b1239f840588.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_d0fb1beb273e1d6c43e8b1239f840588.jpg not downloaded yet
2026-03-30 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_5a26e2a329396b7ab31fa533224872a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY99068/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_f33d4dfdf24d904d71c37349fc3363e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c940ac90>
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_60436cd1c30e863ddf0957fda2db9f8f.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_60436cd1c30e863ddf0957fda2db9f8f.jpg saved to cache
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e16c549f-c68b-593c-887b-d1f47a4cba88
2026-03-30 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_b48da29b6dcb9cc3e526a76c54711e46.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_7a50f3968ac47a2b86d64e06446020a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_7a6ffe488ac15dbb728d654ad0ce93f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 08:31:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:31:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 08:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca898a90>
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_5a26e2a329396b7ab31fa533224872a6.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_5a26e2a329396b7ab31fa533224872a6.jpg saved to cache
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e16c549f-c68b-593c-887b-d1f47a4cba88
2026-03-30 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_898a8d27748f811840fff0b32c01e66c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_7477bc6dd25ade678fe9dae314c83c1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL00014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca8732d0>
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_f33d4dfdf24d904d71c37349fc3363e4.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_f33d4dfdf24d904d71c37349fc3363e4.jpg saved to cache
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7f67b2a-f640-595a-bd30-f8ade4a1878d
2026-03-30 08:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c939f290>
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_b48da29b6dcb9cc3e526a76c54711e46.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_b48da29b6dcb9cc3e526a76c54711e46.jpg saved to cache
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9
2026-03-30 08:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6cc6e19d0>
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_7a50f3968ac47a2b86d64e06446020a1.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_7a50f3968ac47a2b86d64e06446020a1.jpg saved to cache
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9
2026-03-30 08:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c939f290>
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_7a6ffe488ac15dbb728d654ad0ce93f0.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_7a6ffe488ac15dbb728d654ad0ce93f0.jpg saved to cache
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9
2026-03-30 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_536510e5c2d63482ff1c51b7b8638449.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_27719647668987279181ed8210b87cd2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_d0fb1beb273e1d6c43e8b1239f840588.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN63024/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF47293> (referer: https://www.auto1.com/v1/car-details-view/EF47293/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c95660d0>
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_898a8d27748f811840fff0b32c01e66c.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_898a8d27748f811840fff0b32c01e66c.jpg saved to cache
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7f67b2a-f640-595a-bd30-f8ade4a1878d
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca896610>
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_7477bc6dd25ade678fe9dae314c83c1c.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_7477bc6dd25ade678fe9dae314c83c1c.jpg saved to cache
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e16c549f-c68b-593c-887b-d1f47a4cba88
2026-03-30 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_bf6942d22c520b1c2e9606905a1020d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 08:31:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:31:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 08:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6cc970550>
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_536510e5c2d63482ff1c51b7b8638449.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_536510e5c2d63482ff1c51b7b8638449.jpg saved to cache
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e16c549f-c68b-593c-887b-d1f47a4cba88
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7b8e90>
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_27719647668987279181ed8210b87cd2.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_27719647668987279181ed8210b87cd2.jpg saved to cache
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7f67b2a-f640-595a-bd30-f8ade4a1878d
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca660450>
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_d0fb1beb273e1d6c43e8b1239f840588.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_d0fb1beb273e1d6c43e8b1239f840588.jpg saved to cache
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7f67b2a-f640-595a-bd30-f8ade4a1878d
2026-03-30 08:31:28 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1492 | hits on page: 40
2026-03-30 08:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a28c6b07-4f1c-5467-844c-c2384a3a9750 with identifier: EF47293
2026-03-30 08:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a28c6b07-4f1c-5467-844c-c2384a3a9750 with scrape type 1
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a28c6b07-4f1c-5467-844c-c2384a3a9750
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F50%252Fc3508d4c4af67d91974daa21a669e8a5%252Fpa%252FEF47293_dd87f3c3215464b5a6898a30bfe0a648.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_dd87f3c3215464b5a6898a30bfe0a648.jpg already downloaded
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F50%252Fc3508d4c4af67d91974daa21a669e8a5%252Fpa%252FEF47293_643d5fd18f1e3133812e3a3d317fa4ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_643d5fd18f1e3133812e3a3d317fa4ed.jpg already downloaded
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F50%252Fc3508d4c4af67d91974daa21a669e8a5%252Fpa%252FEF47293_fdb8d78bebf96942ec749977b628c31f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_fdb8d78bebf96942ec749977b628c31f.jpg already downloaded
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F50%252Fc3508d4c4af67d91974daa21a669e8a5%252Fpa%252FEF47293_2c21f75bf76c844c0b7c6faac2454c79.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_2c21f75bf76c844c0b7c6faac2454c79.jpg already downloaded
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F50%252Fc3508d4c4af67d91974daa21a669e8a5%252Fpa%252FEF47293_e97dc8d6d78fac2ffcd3129d52f5c47b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_e97dc8d6d78fac2ffcd3129d52f5c47b.jpg already downloaded
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F50%252Fc3508d4c4af67d91974daa21a669e8a5%252Fpa%252FEF47293_1caa09e101c403df483692ed720d8177.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_1caa09e101c403df483692ed720d8177.jpg already downloaded
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F50%252Fc3508d4c4af67d91974daa21a669e8a5%252Fpa%252FEF47293_7e0554181a036cbd8be140f46515c63a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_7e0554181a036cbd8be140f46515c63a.jpg already downloaded
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F50%252Fc3508d4c4af67d91974daa21a669e8a5%252Fpa%252FEF47293_1e9e12c7e7238d86f3ce898ee3cb6990.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_1e9e12c7e7238d86f3ce898ee3cb6990.jpg already downloaded
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F50%252Fc3508d4c4af67d91974daa21a669e8a5%252Fpa%252FEF47293_9f8b57280d3067e60cf7cd3999470ead.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_9f8b57280d3067e60cf7cd3999470ead.jpg already downloaded
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F50%252Fc3508d4c4af67d91974daa21a669e8a5%252Fpa%252FEF47293_72e05c3a4c1b2817d2dfc09bb858e2ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_72e05c3a4c1b2817d2dfc09bb858e2ad.jpg already downloaded
2026-03-30 08:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a28c6b07-4f1c-5467-844c-c2384a3a9750, identifier: EF47293
2026-03-30 08:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a28c6b07-4f1c-5467-844c-c2384a3a9750 with identifier: EF47293
2026-03-30 08:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a28c6b07-4f1c-5467-844c-c2384a3a9750 with identifier: EF47293
2026-03-30 08:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a28c6b07-4f1c-5467-844c-c2384a3a9750 with identifier: EF47293 to the API
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EF47293>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:45:52Z',
 'fuel_type': 'diesel',
 'id': 'a28c6b07-4f1c-5467-844c-c2384a3a9750',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF47293',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 280126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_dd87f3c3215464b5a6898a30bfe0a648.jpg',
                'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_643d5fd18f1e3133812e3a3d317fa4ed.jpg',
                'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_fdb8d78bebf96942ec749977b628c31f.jpg',
                'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_2c21f75bf76c844c0b7c6faac2454c79.jpg',
                'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_e97dc8d6d78fac2ffcd3129d52f5c47b.jpg',
                'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_1caa09e101c403df483692ed720d8177.jpg',
                'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_7e0554181a036cbd8be140f46515c63a.jpg',
                'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_1e9e12c7e7238d86f3ce898ee3cb6990.jpg',
                'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_9f8b57280d3067e60cf7cd3999470ead.jpg',
                'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_72e05c3a4c1b2817d2dfc09bb858e2ad.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28c6b07-4f1c-5467-844c-c2384a3a9750/a28c6b07-4f1c-5467-844c-c2384a3a9750_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_dd87f3c3215464b5a6898a30bfe0a648.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28c6b07-4f1c-5467-844c-c2384a3a9750/a28c6b07-4f1c-5467-844c-c2384a3a9750_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_643d5fd18f1e3133812e3a3d317fa4ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28c6b07-4f1c-5467-844c-c2384a3a9750/a28c6b07-4f1c-5467-844c-c2384a3a9750_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_fdb8d78bebf96942ec749977b628c31f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28c6b07-4f1c-5467-844c-c2384a3a9750/a28c6b07-4f1c-5467-844c-c2384a3a9750_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_2c21f75bf76c844c0b7c6faac2454c79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28c6b07-4f1c-5467-844c-c2384a3a9750/a28c6b07-4f1c-5467-844c-c2384a3a9750_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_e97dc8d6d78fac2ffcd3129d52f5c47b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28c6b07-4f1c-5467-844c-c2384a3a9750/a28c6b07-4f1c-5467-844c-c2384a3a9750_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_1caa09e101c403df483692ed720d8177.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28c6b07-4f1c-5467-844c-c2384a3a9750/a28c6b07-4f1c-5467-844c-c2384a3a9750_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_7e0554181a036cbd8be140f46515c63a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28c6b07-4f1c-5467-844c-c2384a3a9750/a28c6b07-4f1c-5467-844c-c2384a3a9750_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_1e9e12c7e7238d86f3ce898ee3cb6990.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28c6b07-4f1c-5467-844c-c2384a3a9750/a28c6b07-4f1c-5467-844c-c2384a3a9750_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_9f8b57280d3067e60cf7cd3999470ead.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28c6b07-4f1c-5467-844c-c2384a3a9750/a28c6b07-4f1c-5467-844c-c2384a3a9750_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/50/c3508d4c4af67d91974daa21a669e8a5/pa/EF47293_72e05c3a4c1b2817d2dfc09bb858e2ad.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2016}
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF47293%27 HTTP/1.1" 200 None
2026-03-30 08:31:29 [auto1.be] INFO: Saving data for EF47293: {'created_time': 1774859489.828716, 'last_price_update_time': 1774859489.828726, 'auction_closing_time': 1774971952.0}
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EF47293') HTTP/1.1" 204 0
2026-03-30 08:31:29 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-30 08:31:29 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ95996%27 HTTP/1.1" 200 None
2026-03-30 08:31:29 [auto1.be] INFO: Scrape type for RJ95996: 0
2026-03-30 08:31:29 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU32507%27 HTTP/1.1" 200 None
2026-03-30 08:31:29 [auto1.be] INFO: Scrape type for LU32507: 0
2026-03-30 08:31:29 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT44143%27 HTTP/1.1" 200 None
2026-03-30 08:31:30 [auto1.be] INFO: Scrape type for FT44143: 0
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR58028%27 HTTP/1.1" 200 None
2026-03-30 08:31:30 [auto1.be] INFO: Scrape type for VR58028: 0
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES45973%27 HTTP/1.1" 200 None
2026-03-30 08:31:30 [auto1.be] INFO: Scrape type for ES45973: 2
2026-03-30 08:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9eaf71d-903c-5953-a628-6a5d0acabb4e with identifier: ES45973
2026-03-30 08:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9eaf71d-903c-5953-a628-6a5d0acabb4e with scrape type 2
2026-03-30 08:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9eaf71d-903c-5953-a628-6a5d0acabb4e with scrape type 2
2026-03-30 08:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9eaf71d-903c-5953-a628-6a5d0acabb4e, identifier: ES45973
2026-03-30 08:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_2855fd0621c6e095f83f8ad767222a1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_89ff62038c07488f3a10a5935ee18a65.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_7e8dd2051514f64e049d8664ab7fb7e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_c286e8a3798fb267bf59598e94ec5b79.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_8dcbfd7faa8748d6e84092614138ddc8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9eaf71d-903c-5953-a628-6a5d0acabb4e with identifier: ES45973
2026-03-30 08:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9eaf71d-903c-5953-a628-6a5d0acabb4e with identifier: ES45973
2026-03-30 08:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9eaf71d-903c-5953-a628-6a5d0acabb4e with identifier: ES45973 to the API
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:08Z',
 'fuel_type': 'diesel',
 'id': 'b9eaf71d-903c-5953-a628-6a5d0acabb4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES45973',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 222297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-11',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES45973%27 HTTP/1.1" 200 None
2026-03-30 08:31:30 [auto1.be] INFO: Saving data for ES45973: {'auction_closing_time': 1774884248.0, 'created_time': 1774557129.590198, 'last_price_update_time': 1774859490.418961}
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ES45973') HTTP/1.1" 204 0
2026-03-30 08:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK40214/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG04950/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_561123e55d7b57adf857239bfb002a33.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB50362%27 HTTP/1.1" 200 None
2026-03-30 08:31:30 [auto1.be] INFO: Scrape type for MB50362: 0
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-30 08:31:30 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD75254%27 HTTP/1.1" 200 None
2026-03-30 08:31:30 [auto1.be] INFO: Scrape type for AD75254: 2
2026-03-30 08:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 178b732b-b486-509b-836d-ef86c5a63d15 with identifier: AD75254
2026-03-30 08:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178b732b-b486-509b-836d-ef86c5a63d15 with scrape type 2
2026-03-30 08:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 178b732b-b486-509b-836d-ef86c5a63d15 with scrape type 2
2026-03-30 08:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 178b732b-b486-509b-836d-ef86c5a63d15, identifier: AD75254
2026-03-30 08:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca76cd50>
2026-03-30 08:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_bf6942d22c520b1c2e9606905a1020d2.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_bf6942d22c520b1c2e9606905a1020d2.jpg saved to cache
2026-03-30 08:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7f67b2a-f640-595a-bd30-f8ade4a1878d
2026-03-30 08:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 178b732b-b486-509b-836d-ef86c5a63d15 with identifier: AD75254
2026-03-30 08:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 178b732b-b486-509b-836d-ef86c5a63d15 with identifier: AD75254
2026-03-30 08:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 178b732b-b486-509b-836d-ef86c5a63d15 with identifier: AD75254 to the API
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:01:20Z',
 'fuel_type': 'petrol',
 'id': '178b732b-b486-509b-836d-ef86c5a63d15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD75254',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C2',
 'odometer': 93037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-31',
 'seller_name': None,
 'title': 'Citroen C2 1.1 SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2005}
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD75254%27 HTTP/1.1" 200 None
2026-03-30 08:31:30 [auto1.be] INFO: Saving data for AD75254: {'auction_closing_time': 1774882880.0, 'created_time': 1774557118.60337, 'last_price_update_time': 1774859490.949815}
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AD75254') HTTP/1.1" 204 0
2026-03-30 08:31:31 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-30 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-30 08:31:31 [auto1.be] INFO: Scrape type for KM93600: 2
2026-03-30 08:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70ba890e-ae1d-5456-868e-0a257b86508f with identifier: KM93600
2026-03-30 08:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70ba890e-ae1d-5456-868e-0a257b86508f with scrape type 2
2026-03-30 08:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70ba890e-ae1d-5456-868e-0a257b86508f with scrape type 2
2026-03-30 08:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70ba890e-ae1d-5456-868e-0a257b86508f, identifier: KM93600
2026-03-30 08:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70ba890e-ae1d-5456-868e-0a257b86508f with identifier: KM93600
2026-03-30 08:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70ba890e-ae1d-5456-868e-0a257b86508f with identifier: KM93600
2026-03-30 08:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70ba890e-ae1d-5456-868e-0a257b86508f with identifier: KM93600 to the API
2026-03-30 08:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:45:33Z',
 'fuel_type': 'petrol',
 'id': '70ba890e-ae1d-5456-868e-0a257b86508f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM93600',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 244431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-15',
 'seller_name': None,
 'title': 'Dacia Logan MCV 0.9 TCe Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2014}
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-30 08:31:33 [auto1.be] INFO: Saving data for KM93600: {'auction_closing_time': 1774885533.0, 'created_time': 1774125092.705644, 'last_price_update_time': 1774859493.12846}
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KM93600') HTTP/1.1" 204 0
2026-03-30 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE99564> (referer: https://www.auto1.com/v1/car-details-view/AE99564/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca89ded0>
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_2855fd0621c6e095f83f8ad767222a1f.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_2855fd0621c6e095f83f8ad767222a1f.jpg saved to cache
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7f67b2a-f640-595a-bd30-f8ade4a1878d
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7a44d0>
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_89ff62038c07488f3a10a5935ee18a65.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_89ff62038c07488f3a10a5935ee18a65.jpg saved to cache
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7f67b2a-f640-595a-bd30-f8ade4a1878d
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c93e4cd0>
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_7e8dd2051514f64e049d8664ab7fb7e2.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_7e8dd2051514f64e049d8664ab7fb7e2.jpg saved to cache
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e16c549f-c68b-593c-887b-d1f47a4cba88
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7930d0>
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_c286e8a3798fb267bf59598e94ec5b79.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_c286e8a3798fb267bf59598e94ec5b79.jpg saved to cache
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7f67b2a-f640-595a-bd30-f8ade4a1878d
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c93e46d0>
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_8dcbfd7faa8748d6e84092614138ddc8.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_8dcbfd7faa8748d6e84092614138ddc8.jpg saved to cache
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7f67b2a-f640-595a-bd30-f8ade4a1878d
2026-03-30 08:31:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 08:31:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:31:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:31:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 08:31:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7a79d0>
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_561123e55d7b57adf857239bfb002a33.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_561123e55d7b57adf857239bfb002a33.jpg saved to cache
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e16c549f-c68b-593c-887b-d1f47a4cba88
2026-03-30 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_79105ee5ecc93ebca5fca4807addedaf.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:33 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ74663%27 HTTP/1.1" 200 None
2026-03-30 08:31:33 [auto1.be] INFO: Scrape type for JZ74663: 2
2026-03-30 08:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bc2a57f-adf4-537b-ab62-750353b75ae5 with identifier: JZ74663
2026-03-30 08:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bc2a57f-adf4-537b-ab62-750353b75ae5 with scrape type 2
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bc2a57f-adf4-537b-ab62-750353b75ae5 with scrape type 2
2026-03-30 08:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1bc2a57f-adf4-537b-ab62-750353b75ae5, identifier: JZ74663
2026-03-30 08:31:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD88445> (referer: https://www.auto1.com/v1/car-details-view/JD88445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY99068> (referer: https://www.auto1.com/v1/car-details-view/JY99068/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK81975> (referer: https://www.auto1.com/v1/car-details-view/PK81975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_902c14dc1ecaebc72c7183b6703c5449.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_0f4f4d85f196621ff2b9675af9a7b160.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_02a636fbc5f7ec450222f9587c5177d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_f7fa95a5441ae76a9232c5a06bd74d5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1bc2a57f-adf4-537b-ab62-750353b75ae5 with identifier: JZ74663
2026-03-30 08:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1bc2a57f-adf4-537b-ab62-750353b75ae5 with identifier: JZ74663
2026-03-30 08:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1bc2a57f-adf4-537b-ab62-750353b75ae5 with identifier: JZ74663 to the API
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:49:22Z',
 'fuel_type': 'petrol',
 'id': '1bc2a57f-adf4-537b-ab62-750353b75ae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ74663',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 159587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-19',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2011}
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ74663%27 HTTP/1.1" 200 None
2026-03-30 08:31:33 [auto1.be] INFO: Saving data for JZ74663: {'auction_closing_time': 1774885762.0, 'created_time': 1774557154.34689, 'last_price_update_time': 1774859493.859206}
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ74663') HTTP/1.1" 204 0
2026-03-30 08:31:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:33 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW28444%27 HTTP/1.1" 200 None
2026-03-30 08:31:33 [auto1.be] INFO: Scrape type for JW28444: 2
2026-03-30 08:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd07124-f44e-5898-aece-38964db9001a with identifier: JW28444
2026-03-30 08:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd07124-f44e-5898-aece-38964db9001a with scrape type 2
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fd07124-f44e-5898-aece-38964db9001a with scrape type 2
2026-03-30 08:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7fd07124-f44e-5898-aece-38964db9001a, identifier: JW28444
2026-03-30 08:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 996008fc-0532-52f9-a004-0c8ba0069e46 with identifier: AE99564
2026-03-30 08:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 996008fc-0532-52f9-a004-0c8ba0069e46 with scrape type 1
2026-03-30 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 996008fc-0532-52f9-a004-0c8ba0069e46
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_dcb4617edbdd55f5facdbdb045a9b0eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_dcb4617edbdd55f5facdbdb045a9b0eb.jpg not downloaded yet
2026-03-30 08:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7fd07124-f44e-5898-aece-38964db9001a with identifier: JW28444
2026-03-30 08:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7fd07124-f44e-5898-aece-38964db9001a with identifier: JW28444
2026-03-30 08:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7fd07124-f44e-5898-aece-38964db9001a with identifier: JW28444 to the API
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:38:19Z',
 'fuel_type': 'diesel',
 'id': '7fd07124-f44e-5898-aece-38964db9001a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW28444',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 245383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-03',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2009}
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW28444%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [auto1.be] INFO: Saving data for JW28444: {'auction_closing_time': 1774885099.0, 'created_time': 1773138258.256078, 'last_price_update_time': 1774859494.321282}
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW28444') HTTP/1.1" 204 0
2026-03-30 08:31:34 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST41989%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [auto1.be] INFO: Scrape type for ST41989: 0
2026-03-30 08:31:34 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB58546%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [auto1.be] INFO: Scrape type for SB58546: 0
2026-03-30 08:31:34 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN33988%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [auto1.be] INFO: Scrape type for ZN33988: 0
2026-03-30 08:31:34 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV98137%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [auto1.be] INFO: Scrape type for WV98137: 2
2026-03-30 08:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86440280-a356-5fff-8029-b8a24b1d7f49 with identifier: WV98137
2026-03-30 08:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86440280-a356-5fff-8029-b8a24b1d7f49 with scrape type 2
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86440280-a356-5fff-8029-b8a24b1d7f49 with scrape type 2
2026-03-30 08:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 86440280-a356-5fff-8029-b8a24b1d7f49, identifier: WV98137
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_500d9d86fdc2d18d05b1e8d82fad8fdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_500d9d86fdc2d18d05b1e8d82fad8fdd.jpg not downloaded yet
2026-03-30 08:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL00014> (referer: https://www.auto1.com/v1/car-details-view/TL00014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 08:31:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:31:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:31:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 08:31:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 08:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6cce8d190>
2026-03-30 08:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_79105ee5ecc93ebca5fca4807addedaf.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_79105ee5ecc93ebca5fca4807addedaf.jpg saved to cache
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e16c549f-c68b-593c-887b-d1f47a4cba88
2026-03-30 08:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec5b7569-d44a-5391-b72d-9d57115893f7 with identifier: JD88445
2026-03-30 08:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec5b7569-d44a-5391-b72d-9d57115893f7 with scrape type 1
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec5b7569-d44a-5391-b72d-9d57115893f7
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F3b%252F5a3beccc26af196b1be0e16c9f1be553%252Fpa%252FJD88445_287c8fbb9704c61957a3f0e12e7e059e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_287c8fbb9704c61957a3f0e12e7e059e.jpg already downloaded
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F3b%252F5a3beccc26af196b1be0e16c9f1be553%252Fpa%252FJD88445_3992649cbad0a1d9269f0025a97c43c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_3992649cbad0a1d9269f0025a97c43c0.jpg already downloaded
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F3b%252F5a3beccc26af196b1be0e16c9f1be553%252Fpa%252FJD88445_c99ef414cdc3532cd05daf53f676ea77.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_c99ef414cdc3532cd05daf53f676ea77.jpg already downloaded
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F3b%252F5a3beccc26af196b1be0e16c9f1be553%252Fpa%252FJD88445_bd465ec2f9805cbd8632069b373ab71b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_bd465ec2f9805cbd8632069b373ab71b.jpg already downloaded
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F3b%252F5a3beccc26af196b1be0e16c9f1be553%252Fpa%252FJD88445_2954925a7ce44a74279cc3dcfcdf15c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_2954925a7ce44a74279cc3dcfcdf15c6.jpg already downloaded
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F3b%252F5a3beccc26af196b1be0e16c9f1be553%252Fpa%252FJD88445_b1eb3c7c5c7f5beedd4557fa3750fff1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_b1eb3c7c5c7f5beedd4557fa3750fff1.jpg already downloaded
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F3b%252F5a3beccc26af196b1be0e16c9f1be553%252Fpa%252FJD88445_4e680d91c4e7d669a0d3d3cf4c041c3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_4e680d91c4e7d669a0d3d3cf4c041c3c.jpg already downloaded
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F3b%252F5a3beccc26af196b1be0e16c9f1be553%252Fpa%252FJD88445_aaa15cb6ff0468e884375a7842d7fb31.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_aaa15cb6ff0468e884375a7842d7fb31.jpg already downloaded
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F3b%252F5a3beccc26af196b1be0e16c9f1be553%252Fpa%252FJD88445_c86cb8db5a0ec558212ddaba525fc644.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_c86cb8db5a0ec558212ddaba525fc644.jpg already downloaded
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F3b%252F5a3beccc26af196b1be0e16c9f1be553%252Fpa%252FJD88445_59ab37e58c104b5a0d2cbd997966b0b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_59ab37e58c104b5a0d2cbd997966b0b8.jpg already downloaded
2026-03-30 08:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec5b7569-d44a-5391-b72d-9d57115893f7, identifier: JD88445
2026-03-30 08:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96ce9201-3fc2-5a73-9764-8394d51a5fa5 with identifier: JY99068
2026-03-30 08:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96ce9201-3fc2-5a73-9764-8394d51a5fa5 with scrape type 1
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96ce9201-3fc2-5a73-9764-8394d51a5fa5
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52da7d03b76d842cf3b5ba06c8e58d12%252Fpa%252FJY99068_5ff63f05e57d1c515c1a06970463cb3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_5ff63f05e57d1c515c1a06970463cb3f.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52da7d03b76d842cf3b5ba06c8e58d12%252Fpa%252FJY99068_7925259937590cf442d13e1b5d19a7a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_7925259937590cf442d13e1b5d19a7a0.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52da7d03b76d842cf3b5ba06c8e58d12%252Fpa%252FJY99068_3d1541b0ec6bc511a971041d521fb141.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_3d1541b0ec6bc511a971041d521fb141.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52da7d03b76d842cf3b5ba06c8e58d12%252Fpa%252FJY99068_7183cefcc7e5e256ce8798dcf0ae217d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_7183cefcc7e5e256ce8798dcf0ae217d.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52da7d03b76d842cf3b5ba06c8e58d12%252Fpa%252FJY99068_285c413a27319fa3c30133ce22477703.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_285c413a27319fa3c30133ce22477703.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52da7d03b76d842cf3b5ba06c8e58d12%252Fpa%252FJY99068_85de5cdaa4535b9ebafb25a67e6899de.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_85de5cdaa4535b9ebafb25a67e6899de.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52da7d03b76d842cf3b5ba06c8e58d12%252Fpa%252FJY99068_67de669f91560fecc310dfb1e0e1355b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_67de669f91560fecc310dfb1e0e1355b.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52da7d03b76d842cf3b5ba06c8e58d12%252Fpa%252FJY99068_8b8111d685040d0a77867b3450736b70.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_8b8111d685040d0a77867b3450736b70.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52da7d03b76d842cf3b5ba06c8e58d12%252Fpa%252FJY99068_5ac26f24fb0358a3bc054faf0318360e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_5ac26f24fb0358a3bc054faf0318360e.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52da7d03b76d842cf3b5ba06c8e58d12%252Fpa%252FJY99068_2e3e077e8e5fb6f74a16dd24120e0576.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_2e3e077e8e5fb6f74a16dd24120e0576.jpg already downloaded
2026-03-30 08:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96ce9201-3fc2-5a73-9764-8394d51a5fa5, identifier: JY99068
2026-03-30 08:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a737949-0304-570c-9497-1c3430693f23 with identifier: PK81975
2026-03-30 08:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a737949-0304-570c-9497-1c3430693f23 with scrape type 1
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5a737949-0304-570c-9497-1c3430693f23
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc7%252F62c7904c34e85cb64b5723fa6a194e45%252Fpa%252FPK81975_5de7232927be7881b448b32da3ae44a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_5de7232927be7881b448b32da3ae44a7.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc7%252F62c7904c34e85cb64b5723fa6a194e45%252Fpa%252FPK81975_496e8dc147ddbc91da41c3c3507f649a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_496e8dc147ddbc91da41c3c3507f649a.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc7%252F62c7904c34e85cb64b5723fa6a194e45%252Fpa%252FPK81975_96fe63d78ab0ae57d8a3e82ab3b1af4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_96fe63d78ab0ae57d8a3e82ab3b1af4c.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc7%252F62c7904c34e85cb64b5723fa6a194e45%252Fpa%252FPK81975_293204de62a76aeeb6a9c346850e1774.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_293204de62a76aeeb6a9c346850e1774.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc7%252F62c7904c34e85cb64b5723fa6a194e45%252Fpa%252FPK81975_3c89d8f6ee47b0a91210aa8237b0f4fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_3c89d8f6ee47b0a91210aa8237b0f4fd.jpg already downloaded
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc7%252F62c7904c34e85cb64b5723fa6a194e45%252Fpa%252FPK81975_01c57ca9d5a77ca33d5f6117ad2e1054.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_01c57ca9d5a77ca33d5f6117ad2e1054.jpg already downloaded
2026-03-30 08:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a737949-0304-570c-9497-1c3430693f23, identifier: PK81975
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca6ecbd0>
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_902c14dc1ecaebc72c7183b6703c5449.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_902c14dc1ecaebc72c7183b6703c5449.jpg saved to cache
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e16c549f-c68b-593c-887b-d1f47a4cba88
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca90bb10>
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_0f4f4d85f196621ff2b9675af9a7b160.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_0f4f4d85f196621ff2b9675af9a7b160.jpg saved to cache
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a740f60-629c-5dfd-a0c4-f760f6169e45
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c955f6d0>
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_02a636fbc5f7ec450222f9587c5177d5.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_02a636fbc5f7ec450222f9587c5177d5.jpg saved to cache
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca62fd50>
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F46%252F9946de8ba94085b4089fc191e999e01a%252Fpa%252FNH91226_f7fa95a5441ae76a9232c5a06bd74d5d.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_f7fa95a5441ae76a9232c5a06bd74d5d.jpg saved to cache
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7f67b2a-f640-595a-bd30-f8ade4a1878d
2026-03-30 08:31:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7f67b2a-f640-595a-bd30-f8ade4a1878d, skipping ID generation
2026-03-30 08:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f67b2a-f640-595a-bd30-f8ade4a1878d with scrape type 1
2026-03-30 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7f67b2a-f640-595a-bd30-f8ade4a1878d sending to next pipeline
2026-03-30 08:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7f67b2a-f640-595a-bd30-f8ade4a1878d, identifier: NH91226
2026-03-30 08:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_111c5b6803f809ae566e3a06bd25f041.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 86440280-a356-5fff-8029-b8a24b1d7f49 with identifier: WV98137
2026-03-30 08:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 86440280-a356-5fff-8029-b8a24b1d7f49 with identifier: WV98137
2026-03-30 08:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 86440280-a356-5fff-8029-b8a24b1d7f49 with identifier: WV98137 to the API
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 40,
 'expiration_date': '2026-03-30T15:18:09Z',
 'fuel_type': 'diesel',
 'id': '86440280-a356-5fff-8029-b8a24b1d7f49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV98137',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 115035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-22',
 'seller_name': None,
 'title': 'Smart fortwo 0.8 CDI Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2006}
2026-03-30 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV98137%27 HTTP/1.1" 200 None
2026-03-30 08:31:36 [auto1.be] INFO: Saving data for WV98137: {'auction_closing_time': 1774883889.0, 'created_time': 1773347655.760948, 'last_price_update_time': 1774859496.002951}
2026-03-30 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV98137') HTTP/1.1" 204 0
2026-03-30 08:31:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec5b7569-d44a-5391-b72d-9d57115893f7 with identifier: JD88445
2026-03-30 08:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:31:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 08:31:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec5b7569-d44a-5391-b72d-9d57115893f7 with identifier: JD88445
2026-03-30 08:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec5b7569-d44a-5391-b72d-9d57115893f7 with identifier: JD88445 to the API
2026-03-30 08:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JD88445>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:54:31Z',
 'fuel_type': 'petrol',
 'id': 'ec5b7569-d44a-5391-b72d-9d57115893f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD88445',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 182813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_287c8fbb9704c61957a3f0e12e7e059e.jpg',
                'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_3992649cbad0a1d9269f0025a97c43c0.jpg',
                'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_c99ef414cdc3532cd05daf53f676ea77.jpg',
                'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_bd465ec2f9805cbd8632069b373ab71b.jpg',
                'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_2954925a7ce44a74279cc3dcfcdf15c6.jpg',
                'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_b1eb3c7c5c7f5beedd4557fa3750fff1.jpg',
                'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_4e680d91c4e7d669a0d3d3cf4c041c3c.jpg',
                'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_aaa15cb6ff0468e884375a7842d7fb31.jpg',
                'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_c86cb8db5a0ec558212ddaba525fc644.jpg',
                'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_59ab37e58c104b5a0d2cbd997966b0b8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5b7569-d44a-5391-b72d-9d57115893f7/ec5b7569-d44a-5391-b72d-9d57115893f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_287c8fbb9704c61957a3f0e12e7e059e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5b7569-d44a-5391-b72d-9d57115893f7/ec5b7569-d44a-5391-b72d-9d57115893f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_3992649cbad0a1d9269f0025a97c43c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5b7569-d44a-5391-b72d-9d57115893f7/ec5b7569-d44a-5391-b72d-9d57115893f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_c99ef414cdc3532cd05daf53f676ea77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5b7569-d44a-5391-b72d-9d57115893f7/ec5b7569-d44a-5391-b72d-9d57115893f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_bd465ec2f9805cbd8632069b373ab71b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5b7569-d44a-5391-b72d-9d57115893f7/ec5b7569-d44a-5391-b72d-9d57115893f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_2954925a7ce44a74279cc3dcfcdf15c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5b7569-d44a-5391-b72d-9d57115893f7/ec5b7569-d44a-5391-b72d-9d57115893f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_b1eb3c7c5c7f5beedd4557fa3750fff1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5b7569-d44a-5391-b72d-9d57115893f7/ec5b7569-d44a-5391-b72d-9d57115893f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_4e680d91c4e7d669a0d3d3cf4c041c3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5b7569-d44a-5391-b72d-9d57115893f7/ec5b7569-d44a-5391-b72d-9d57115893f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_aaa15cb6ff0468e884375a7842d7fb31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5b7569-d44a-5391-b72d-9d57115893f7/ec5b7569-d44a-5391-b72d-9d57115893f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_c86cb8db5a0ec558212ddaba525fc644.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec5b7569-d44a-5391-b72d-9d57115893f7/ec5b7569-d44a-5391-b72d-9d57115893f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/3b/5a3beccc26af196b1be0e16c9f1be553/pa/JD88445_59ab37e58c104b5a0d2cbd997966b0b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Premium 2WD',
 'transmission': 'manual',
 'trim': 'Premium 2WD',
 'year': 2019}
2026-03-30 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD88445%27 HTTP/1.1" 200 None
2026-03-30 08:31:36 [auto1.be] INFO: Saving data for JD88445: {'created_time': 1774859496.957295, 'last_price_update_time': 1774859496.957306, 'auction_closing_time': 1774972471.0}
2026-03-30 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JD88445') HTTP/1.1" 204 0
2026-03-30 08:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96ce9201-3fc2-5a73-9764-8394d51a5fa5 with identifier: JY99068
2026-03-30 08:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96ce9201-3fc2-5a73-9764-8394d51a5fa5 with identifier: JY99068
2026-03-30 08:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96ce9201-3fc2-5a73-9764-8394d51a5fa5 with identifier: JY99068 to the API
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JY99068>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:20:59Z',
 'fuel_type': 'petrol',
 'id': '96ce9201-3fc2-5a73-9764-8394d51a5fa5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY99068',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 127618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_5ff63f05e57d1c515c1a06970463cb3f.jpg',
                'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_7925259937590cf442d13e1b5d19a7a0.jpg',
                'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_3d1541b0ec6bc511a971041d521fb141.jpg',
                'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_7183cefcc7e5e256ce8798dcf0ae217d.jpg',
                'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_285c413a27319fa3c30133ce22477703.jpg',
                'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_85de5cdaa4535b9ebafb25a67e6899de.jpg',
                'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_67de669f91560fecc310dfb1e0e1355b.jpg',
                'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_8b8111d685040d0a77867b3450736b70.jpg',
                'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_5ac26f24fb0358a3bc054faf0318360e.jpg',
                'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_2e3e077e8e5fb6f74a16dd24120e0576.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96ce9201-3fc2-5a73-9764-8394d51a5fa5/96ce9201-3fc2-5a73-9764-8394d51a5fa5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_5ff63f05e57d1c515c1a06970463cb3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96ce9201-3fc2-5a73-9764-8394d51a5fa5/96ce9201-3fc2-5a73-9764-8394d51a5fa5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_7925259937590cf442d13e1b5d19a7a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96ce9201-3fc2-5a73-9764-8394d51a5fa5/96ce9201-3fc2-5a73-9764-8394d51a5fa5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_3d1541b0ec6bc511a971041d521fb141.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96ce9201-3fc2-5a73-9764-8394d51a5fa5/96ce9201-3fc2-5a73-9764-8394d51a5fa5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_7183cefcc7e5e256ce8798dcf0ae217d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96ce9201-3fc2-5a73-9764-8394d51a5fa5/96ce9201-3fc2-5a73-9764-8394d51a5fa5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_285c413a27319fa3c30133ce22477703.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96ce9201-3fc2-5a73-9764-8394d51a5fa5/96ce9201-3fc2-5a73-9764-8394d51a5fa5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_85de5cdaa4535b9ebafb25a67e6899de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96ce9201-3fc2-5a73-9764-8394d51a5fa5/96ce9201-3fc2-5a73-9764-8394d51a5fa5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_67de669f91560fecc310dfb1e0e1355b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96ce9201-3fc2-5a73-9764-8394d51a5fa5/96ce9201-3fc2-5a73-9764-8394d51a5fa5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_8b8111d685040d0a77867b3450736b70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96ce9201-3fc2-5a73-9764-8394d51a5fa5/96ce9201-3fc2-5a73-9764-8394d51a5fa5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_5ac26f24fb0358a3bc054faf0318360e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96ce9201-3fc2-5a73-9764-8394d51a5fa5/96ce9201-3fc2-5a73-9764-8394d51a5fa5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52da7d03b76d842cf3b5ba06c8e58d12/pa/JY99068_2e3e077e8e5fb6f74a16dd24120e0576.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY99068%27 HTTP/1.1" 200 None
2026-03-30 08:31:37 [auto1.be] INFO: Saving data for JY99068: {'created_time': 1774859497.297414, 'last_price_update_time': 1774859497.297426, 'auction_closing_time': 1774970459.0}
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JY99068') HTTP/1.1" 204 0
2026-03-30 08:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a737949-0304-570c-9497-1c3430693f23 with identifier: PK81975
2026-03-30 08:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a737949-0304-570c-9497-1c3430693f23 with identifier: PK81975
2026-03-30 08:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a737949-0304-570c-9497-1c3430693f23 with identifier: PK81975 to the API
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PK81975>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:47:39Z',
 'fuel_type': 'diesel',
 'id': '5a737949-0304-570c-9497-1c3430693f23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK81975',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 149096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_5de7232927be7881b448b32da3ae44a7.jpg',
                'https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_496e8dc147ddbc91da41c3c3507f649a.jpg',
                'https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_96fe63d78ab0ae57d8a3e82ab3b1af4c.jpg',
                'https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_293204de62a76aeeb6a9c346850e1774.jpg',
                'https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_3c89d8f6ee47b0a91210aa8237b0f4fd.jpg',
                'https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_01c57ca9d5a77ca33d5f6117ad2e1054.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a737949-0304-570c-9497-1c3430693f23/5a737949-0304-570c-9497-1c3430693f23_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_5de7232927be7881b448b32da3ae44a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a737949-0304-570c-9497-1c3430693f23/5a737949-0304-570c-9497-1c3430693f23_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_496e8dc147ddbc91da41c3c3507f649a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a737949-0304-570c-9497-1c3430693f23/5a737949-0304-570c-9497-1c3430693f23_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_96fe63d78ab0ae57d8a3e82ab3b1af4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a737949-0304-570c-9497-1c3430693f23/5a737949-0304-570c-9497-1c3430693f23_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_293204de62a76aeeb6a9c346850e1774.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a737949-0304-570c-9497-1c3430693f23/5a737949-0304-570c-9497-1c3430693f23_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_3c89d8f6ee47b0a91210aa8237b0f4fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a737949-0304-570c-9497-1c3430693f23/5a737949-0304-570c-9497-1c3430693f23_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c7/62c7904c34e85cb64b5723fa6a194e45/pa/PK81975_01c57ca9d5a77ca33d5f6117ad2e1054.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 CDI Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2008}
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK81975%27 HTTP/1.1" 200 None
2026-03-30 08:31:37 [auto1.be] INFO: Saving data for PK81975: {'created_time': 1774859497.643816, 'last_price_update_time': 1774859497.643829, 'auction_closing_time': 1774972059.0}
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PK81975') HTTP/1.1" 204 0
2026-03-30 08:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7f67b2a-f640-595a-bd30-f8ade4a1878d with identifier: NH91226
2026-03-30 08:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7f67b2a-f640-595a-bd30-f8ade4a1878d with identifier: NH91226
2026-03-30 08:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7f67b2a-f640-595a-bd30-f8ade4a1878d with identifier: NH91226 to the API
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_f7fa95a5441ae76a9232c5a06bd74d5d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:49:21Z',
 'fuel_type': 'diesel',
 'id': 'b7f67b2a-f640-595a-bd30-f8ade4a1878d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH91226',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 161450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_f7fa95a5441ae76a9232c5a06bd74d5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_8dcbfd7faa8748d6e84092614138ddc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_c286e8a3798fb267bf59598e94ec5b79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_f33d4dfdf24d904d71c37349fc3363e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_89ff62038c07488f3a10a5935ee18a65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_2855fd0621c6e095f83f8ad767222a1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_bf6942d22c520b1c2e9606905a1020d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_898a8d27748f811840fff0b32c01e66c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_27719647668987279181ed8210b87cd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f67b2a-f640-595a-bd30-f8ade4a1878d/b7f67b2a-f640-595a-bd30-f8ade4a1878d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/46/9946de8ba94085b4089fc191e999e01a/pa/NH91226_d0fb1beb273e1d6c43e8b1239f840588.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 SE Dynamic',
 'transmission': 'automatic',
 'trim': 'SE Dynamic',
 'year': 2019}
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH91226%27 HTTP/1.1" 200 None
2026-03-30 08:31:38 [auto1.be] INFO: Saving data for NH91226: {'created_time': 1774859498.042677, 'last_price_update_time': 1774859498.042691, 'auction_closing_time': 1774972161.0}
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NH91226') HTTP/1.1" 204 0
2026-03-30 08:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_b49c853dd725a8380c54f5294521fcc1.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_38d815d9b350e349713763872a00bbe2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_fb518a5e66eae4397ea5b64fc48dbc61.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:38 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM98444%27 HTTP/1.1" 200 None
2026-03-30 08:31:38 [auto1.be] INFO: Scrape type for WM98444: 0
2026-03-30 08:31:38 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-30 08:31:38 [auto1.be] INFO: Scrape type for YL67549: 2
2026-03-30 08:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 871fb17f-43c0-51df-83fe-8fd9f9a98293 with identifier: YL67549
2026-03-30 08:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 871fb17f-43c0-51df-83fe-8fd9f9a98293 with scrape type 2
2026-03-30 08:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 871fb17f-43c0-51df-83fe-8fd9f9a98293 with scrape type 2
2026-03-30 08:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 871fb17f-43c0-51df-83fe-8fd9f9a98293, identifier: YL67549
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_7e17255513f9ae1489fdb2280aa04960.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_7e17255513f9ae1489fdb2280aa04960.jpg not downloaded yet
2026-03-30 08:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN63024> (referer: https://www.auto1.com/v1/car-details-view/CN63024/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 871fb17f-43c0-51df-83fe-8fd9f9a98293 with identifier: YL67549
2026-03-30 08:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 871fb17f-43c0-51df-83fe-8fd9f9a98293 with identifier: YL67549
2026-03-30 08:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 871fb17f-43c0-51df-83fe-8fd9f9a98293 with identifier: YL67549 to the API
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:56:56Z',
 'fuel_type': 'petrol',
 'id': '871fb17f-43c0-51df-83fe-8fd9f9a98293',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL67549',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 214666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-29',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2012}
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-30 08:31:38 [auto1.be] INFO: Saving data for YL67549: {'auction_closing_time': 1774886216.0, 'created_time': 1774643569.947744, 'last_price_update_time': 1774859498.4816}
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YL67549') HTTP/1.1" 204 0
2026-03-30 08:31:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:38 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-30 08:31:38 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-30 08:31:38 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-30 08:31:38 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-30 08:31:38 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE45749%27 HTTP/1.1" 200 None
2026-03-30 08:31:38 [auto1.be] INFO: Scrape type for NE45749: 0
2026-03-30 08:31:38 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-30 08:31:38 [auto1.be] INFO: Scrape type for VP73114: 2
2026-03-30 08:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39c332e4-ce8d-57bf-9435-f66638edd52e with identifier: VP73114
2026-03-30 08:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c332e4-ce8d-57bf-9435-f66638edd52e with scrape type 2
2026-03-30 08:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39c332e4-ce8d-57bf-9435-f66638edd52e with scrape type 2
2026-03-30 08:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 39c332e4-ce8d-57bf-9435-f66638edd52e, identifier: VP73114
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_cbb08f2886b6fe5643f15a676085062b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_cbb08f2886b6fe5643f15a676085062b.jpg not downloaded yet
2026-03-30 08:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 39c332e4-ce8d-57bf-9435-f66638edd52e with identifier: VP73114
2026-03-30 08:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 39c332e4-ce8d-57bf-9435-f66638edd52e with identifier: VP73114
2026-03-30 08:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 39c332e4-ce8d-57bf-9435-f66638edd52e with identifier: VP73114 to the API
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:13:19Z',
 'fuel_type': 'diesel',
 'id': '39c332e4-ce8d-57bf-9435-f66638edd52e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP73114',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 403007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-10',
 'seller_name': None,
 'title': 'Toyota Avensis 2.0 D-4D',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-30 08:31:38 [auto1.be] INFO: Saving data for VP73114: {'auction_closing_time': 1774883599.0, 'created_time': 1774125108.714113, 'last_price_update_time': 1774859498.987965}
2026-03-30 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP73114') HTTP/1.1" 204 0
2026-03-30 08:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3ca36ac-a21b-5b97-80ce-fa61660bdd70 with identifier: TL00014
2026-03-30 08:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3ca36ac-a21b-5b97-80ce-fa61660bdd70 with scrape type 1
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3ca36ac-a21b-5b97-80ce-fa61660bdd70
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a0afad1fbf2b0f5fbe71ace31b695%252Fpa%252FTL00014_a2cda0ce68fe654cb37310b44fa1e634.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_a2cda0ce68fe654cb37310b44fa1e634.jpg already downloaded
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a0afad1fbf2b0f5fbe71ace31b695%252Fpa%252FTL00014_cb9bab0183392337dd782982f693d016.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_cb9bab0183392337dd782982f693d016.jpg already downloaded
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a0afad1fbf2b0f5fbe71ace31b695%252Fpa%252FTL00014_0718936949b537fadf53a975ba74366d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_0718936949b537fadf53a975ba74366d.jpg already downloaded
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a0afad1fbf2b0f5fbe71ace31b695%252Fpa%252FTL00014_1efb2ba97a5fa143bb92ec74f7d8aef6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_1efb2ba97a5fa143bb92ec74f7d8aef6.jpg already downloaded
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a0afad1fbf2b0f5fbe71ace31b695%252Fpa%252FTL00014_e797bfaa439fdb5eb252af050b2f3c88.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_e797bfaa439fdb5eb252af050b2f3c88.jpg already downloaded
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a0afad1fbf2b0f5fbe71ace31b695%252Fpa%252FTL00014_8c179cac77d68b302acacb659538a852.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_8c179cac77d68b302acacb659538a852.jpg already downloaded
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a0afad1fbf2b0f5fbe71ace31b695%252Fpa%252FTL00014_8b2282de37f8112f1e186047cf0aee0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_8b2282de37f8112f1e186047cf0aee0d.jpg already downloaded
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a0afad1fbf2b0f5fbe71ace31b695%252Fpa%252FTL00014_4bf6a3f2f663f040c0e98733de8cd66f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_4bf6a3f2f663f040c0e98733de8cd66f.jpg already downloaded
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a0afad1fbf2b0f5fbe71ace31b695%252Fpa%252FTL00014_1490d01929cc2241a2ef4fa174db880b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_1490d01929cc2241a2ef4fa174db880b.jpg already downloaded
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a0afad1fbf2b0f5fbe71ace31b695%252Fpa%252FTL00014_3895407a3bfd185eb05d84c5fe7f2fd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_3895407a3bfd185eb05d84c5fe7f2fd0.jpg already downloaded
2026-03-30 08:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3ca36ac-a21b-5b97-80ce-fa61660bdd70, identifier: TL00014
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9431950>
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_111c5b6803f809ae566e3a06bd25f041.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_111c5b6803f809ae566e3a06bd25f041.jpg saved to cache
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a740f60-629c-5dfd-a0c4-f760f6169e45
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9560710>
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_b49c853dd725a8380c54f5294521fcc1.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_b49c853dd725a8380c54f5294521fcc1.jpg saved to cache
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a740f60-629c-5dfd-a0c4-f760f6169e45
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca710bd0>
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F98%252Ffb98d9635d209e49ed4fcc80d7963458%252Fpa%252FFU28808_38d815d9b350e349713763872a00bbe2.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_38d815d9b350e349713763872a00bbe2.jpg saved to cache
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a740f60-629c-5dfd-a0c4-f760f6169e45
2026-03-30 08:31:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a740f60-629c-5dfd-a0c4-f760f6169e45, skipping ID generation
2026-03-30 08:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a740f60-629c-5dfd-a0c4-f760f6169e45 with scrape type 1
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a740f60-629c-5dfd-a0c4-f760f6169e45 sending to next pipeline
2026-03-30 08:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a740f60-629c-5dfd-a0c4-f760f6169e45, identifier: FU28808
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7573d0>
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F46%252F264694516d49a9b8f24f99662a09b663%252Fpa%252FGS30663_fb518a5e66eae4397ea5b64fc48dbc61.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_fb518a5e66eae4397ea5b64fc48dbc61.jpg saved to cache
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4
2026-03-30 08:31:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a254d639-79a5-50cf-b3f7-b1dd9c861eb4, skipping ID generation
2026-03-30 08:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4 with scrape type 1
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a254d639-79a5-50cf-b3f7-b1dd9c861eb4 sending to next pipeline
2026-03-30 08:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a254d639-79a5-50cf-b3f7-b1dd9c861eb4, identifier: GS30663
2026-03-30 08:31:39 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS85102%27 HTTP/1.1" 200 None
2026-03-30 08:31:39 [auto1.be] INFO: Scrape type for XS85102: 2
2026-03-30 08:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f29606f-b248-5c6b-a0ae-b4cbd130d88b with identifier: XS85102
2026-03-30 08:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f29606f-b248-5c6b-a0ae-b4cbd130d88b with scrape type 2
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f29606f-b248-5c6b-a0ae-b4cbd130d88b with scrape type 2
2026-03-30 08:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f29606f-b248-5c6b-a0ae-b4cbd130d88b, identifier: XS85102
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_f44b0d691f1bac183a653bcd8c8476fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_f44b0d691f1bac183a653bcd8c8476fc.jpg not downloaded yet
2026-03-30 08:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3ca36ac-a21b-5b97-80ce-fa61660bdd70 with identifier: TL00014
2026-03-30 08:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3ca36ac-a21b-5b97-80ce-fa61660bdd70 with identifier: TL00014
2026-03-30 08:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3ca36ac-a21b-5b97-80ce-fa61660bdd70 with identifier: TL00014 to the API
2026-03-30 08:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TL00014>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:42:41Z',
 'fuel_type': 'petrol',
 'id': 'c3ca36ac-a21b-5b97-80ce-fa61660bdd70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL00014',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 28052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_a2cda0ce68fe654cb37310b44fa1e634.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_cb9bab0183392337dd782982f693d016.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_0718936949b537fadf53a975ba74366d.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_1efb2ba97a5fa143bb92ec74f7d8aef6.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_e797bfaa439fdb5eb252af050b2f3c88.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_8c179cac77d68b302acacb659538a852.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_8b2282de37f8112f1e186047cf0aee0d.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_4bf6a3f2f663f040c0e98733de8cd66f.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_1490d01929cc2241a2ef4fa174db880b.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_3895407a3bfd185eb05d84c5fe7f2fd0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ca36ac-a21b-5b97-80ce-fa61660bdd70/c3ca36ac-a21b-5b97-80ce-fa61660bdd70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_a2cda0ce68fe654cb37310b44fa1e634.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ca36ac-a21b-5b97-80ce-fa61660bdd70/c3ca36ac-a21b-5b97-80ce-fa61660bdd70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_cb9bab0183392337dd782982f693d016.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ca36ac-a21b-5b97-80ce-fa61660bdd70/c3ca36ac-a21b-5b97-80ce-fa61660bdd70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_0718936949b537fadf53a975ba74366d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ca36ac-a21b-5b97-80ce-fa61660bdd70/c3ca36ac-a21b-5b97-80ce-fa61660bdd70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_1efb2ba97a5fa143bb92ec74f7d8aef6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ca36ac-a21b-5b97-80ce-fa61660bdd70/c3ca36ac-a21b-5b97-80ce-fa61660bdd70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_e797bfaa439fdb5eb252af050b2f3c88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ca36ac-a21b-5b97-80ce-fa61660bdd70/c3ca36ac-a21b-5b97-80ce-fa61660bdd70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_8c179cac77d68b302acacb659538a852.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ca36ac-a21b-5b97-80ce-fa61660bdd70/c3ca36ac-a21b-5b97-80ce-fa61660bdd70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2056848,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_8b2282de37f8112f1e186047cf0aee0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ca36ac-a21b-5b97-80ce-fa61660bdd70/c3ca36ac-a21b-5b97-80ce-fa61660bdd70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2139008,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_4bf6a3f2f663f040c0e98733de8cd66f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ca36ac-a21b-5b97-80ce-fa61660bdd70/c3ca36ac-a21b-5b97-80ce-fa61660bdd70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_1490d01929cc2241a2ef4fa174db880b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ca36ac-a21b-5b97-80ce-fa61660bdd70/c3ca36ac-a21b-5b97-80ce-fa61660bdd70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a0afad1fbf2b0f5fbe71ace31b695/pa/TL00014_3895407a3bfd185eb05d84c5fe7f2fd0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2013}
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL00014%27 HTTP/1.1" 200 None
2026-03-30 08:31:40 [auto1.be] INFO: Saving data for TL00014: {'created_time': 1774859500.178386, 'last_price_update_time': 1774859500.178397, 'auction_closing_time': 1774971761.0}
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TL00014') HTTP/1.1" 204 0
2026-03-30 08:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a740f60-629c-5dfd-a0c4-f760f6169e45 with identifier: FU28808
2026-03-30 08:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a740f60-629c-5dfd-a0c4-f760f6169e45 with identifier: FU28808
2026-03-30 08:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a740f60-629c-5dfd-a0c4-f760f6169e45 with identifier: FU28808 to the API
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_38d815d9b350e349713763872a00bbe2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:32:02Z',
 'fuel_type': 'petrol',
 'id': '0a740f60-629c-5dfd-a0c4-f760f6169e45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU28808',
 'listing': 'auction',
 'location': 'BE',
 'make': 'BMW',
 'model': '1er',
 'odometer': 128299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_963c12f4e423a5fec420f9a03495f42c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_452b235847678eb2aaa78ae1c68036b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_9227d992897ab54f89ff5f232c4805eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_68e98553930cea71a4df582e6b7e93c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_b49c853dd725a8380c54f5294521fcc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_db1e8cde27c8f6b42233d77b3d2ff92b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_38d815d9b350e349713763872a00bbe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_111c5b6803f809ae566e3a06bd25f041.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_61230a106caaed0b108e203270b62e21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f60-629c-5dfd-a0c4-f760f6169e45/0a740f60-629c-5dfd-a0c4-f760f6169e45_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/98/fb98d9635d209e49ed4fcc80d7963458/pa/FU28808_0f4f4d85f196621ff2b9675af9a7b160.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU28808%27 HTTP/1.1" 200 None
2026-03-30 08:31:40 [auto1.be] INFO: Saving data for FU28808: {'created_time': 1774859500.560537, 'last_price_update_time': 1774859500.560551, 'auction_closing_time': 1774971122.0}
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FU28808') HTTP/1.1" 204 0
2026-03-30 08:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a254d639-79a5-50cf-b3f7-b1dd9c861eb4 with identifier: GS30663
2026-03-30 08:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a254d639-79a5-50cf-b3f7-b1dd9c861eb4 with identifier: GS30663
2026-03-30 08:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a254d639-79a5-50cf-b3f7-b1dd9c861eb4 with identifier: GS30663 to the API
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_fb518a5e66eae4397ea5b64fc48dbc61.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:18:39Z',
 'fuel_type': 'diesel',
 'id': 'a254d639-79a5-50cf-b3f7-b1dd9c861eb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS30663',
 'listing': 'auction',
 'location': 'BE',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 196746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_b5a10072364cb67f227e668032a804f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_509ea976703f75f64086828925af3944.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_fb518a5e66eae4397ea5b64fc48dbc61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_1237cf624e531eaa51913357e20620aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_77d22838b4bf24f1513fd4b7e4a342e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_02a636fbc5f7ec450222f9587c5177d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_18082e8da59ce703ab1ef8e7f81205dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_58a0270f5d9c888abe39574f3ce6cf44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_f629d57d145499d87b1ac024e250f92e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a254d639-79a5-50cf-b3f7-b1dd9c861eb4/a254d639-79a5-50cf-b3f7-b1dd9c861eb4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/46/264694516d49a9b8f24f99662a09b663/pa/GS30663_784009ad3865a1e2eecdab75dc86e417.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS30663%27 HTTP/1.1" 200 None
2026-03-30 08:31:40 [auto1.be] INFO: Saving data for GS30663: {'created_time': 1774859500.952902, 'last_price_update_time': 1774859500.952914, 'auction_closing_time': 1774970319.0}
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS30663') HTTP/1.1" 204 0
2026-03-30 08:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_dcb4617edbdd55f5facdbdb045a9b0eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f29606f-b248-5c6b-a0ae-b4cbd130d88b with identifier: XS85102
2026-03-30 08:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f29606f-b248-5c6b-a0ae-b4cbd130d88b with identifier: XS85102
2026-03-30 08:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f29606f-b248-5c6b-a0ae-b4cbd130d88b with identifier: XS85102 to the API
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:44:04Z',
 'fuel_type': 'petrol',
 'id': '2f29606f-b248-5c6b-a0ae-b4cbd130d88b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS85102',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 150978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-06-18',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 Chrono',
 'transmission': 'manual',
 'trim': 'Chrono',
 'year': 2003}
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS85102%27 HTTP/1.1" 200 None
2026-03-30 08:31:41 [auto1.be] INFO: Saving data for XS85102: {'auction_closing_time': 1774885444.0, 'created_time': 1773131822.568748, 'last_price_update_time': 1774859501.241226}
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XS85102') HTTP/1.1" 204 0
2026-03-30 08:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419 with identifier: CN63024
2026-03-30 08:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419 with scrape type 1
2026-03-30 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fba%252Fd0ba7c6abe69e5ac82eaeaecd66a43d1%252Fpa%252FCN63024_d20053720e43459591c16e5baced0cb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_d20053720e43459591c16e5baced0cb5.jpg already downloaded
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fba%252Fd0ba7c6abe69e5ac82eaeaecd66a43d1%252Fpa%252FCN63024_16387b37e5a509192a637a3ce0bdbda6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_16387b37e5a509192a637a3ce0bdbda6.jpg already downloaded
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fba%252Fd0ba7c6abe69e5ac82eaeaecd66a43d1%252Fpa%252FCN63024_bd6756a450b7f810322deb67638565c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_bd6756a450b7f810322deb67638565c8.jpg already downloaded
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fba%252Fd0ba7c6abe69e5ac82eaeaecd66a43d1%252Fpa%252FCN63024_24772525607ad76f49e587ff22d4829e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_24772525607ad76f49e587ff22d4829e.jpg already downloaded
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fba%252Fd0ba7c6abe69e5ac82eaeaecd66a43d1%252Fpa%252FCN63024_3787ebfd482b033205ed13bbe66b3e18.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_3787ebfd482b033205ed13bbe66b3e18.jpg already downloaded
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fba%252Fd0ba7c6abe69e5ac82eaeaecd66a43d1%252Fpa%252FCN63024_929b5afa0a8a2d11f47c367adfb439c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_929b5afa0a8a2d11f47c367adfb439c3.jpg already downloaded
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fba%252Fd0ba7c6abe69e5ac82eaeaecd66a43d1%252Fpa%252FCN63024_4137c897831016378c5b2b37ef64d1a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_4137c897831016378c5b2b37ef64d1a4.jpg already downloaded
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fba%252Fd0ba7c6abe69e5ac82eaeaecd66a43d1%252Fpa%252FCN63024_07c7b245b82cf3a4e3d22e23bee12b39.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_07c7b245b82cf3a4e3d22e23bee12b39.jpg already downloaded
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fba%252Fd0ba7c6abe69e5ac82eaeaecd66a43d1%252Fpa%252FCN63024_5f65077909d952a7c619bba2b722a3c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_5f65077909d952a7c619bba2b722a3c7.jpg already downloaded
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fba%252Fd0ba7c6abe69e5ac82eaeaecd66a43d1%252Fpa%252FCN63024_42d10c28a70a7aee10946b02908fd0d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_42d10c28a70a7aee10946b02908fd0d5.jpg already downloaded
2026-03-30 08:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419, identifier: CN63024
2026-03-30 08:31:41 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1492 | hits on page: 40
2026-03-30 08:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_500d9d86fdc2d18d05b1e8d82fad8fdd.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:41 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB22067%27 HTTP/1.1" 200 None
2026-03-30 08:31:41 [auto1.be] INFO: Scrape type for GB22067: 2
2026-03-30 08:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb1b23b-941d-515f-804f-64ee546d9ae3 with identifier: GB22067
2026-03-30 08:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb1b23b-941d-515f-804f-64ee546d9ae3 with scrape type 2
2026-03-30 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb1b23b-941d-515f-804f-64ee546d9ae3 with scrape type 2
2026-03-30 08:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: efb1b23b-941d-515f-804f-64ee546d9ae3, identifier: GB22067
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_1aa5b5f744164950ab2d800b090b2a59.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_1aa5b5f744164950ab2d800b090b2a59.jpg not downloaded yet
2026-03-30 08:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK40214> (referer: https://www.auto1.com/v1/car-details-view/VK40214/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG04950> (referer: https://www.auto1.com/v1/car-details-view/FG04950/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH13121/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419 with identifier: CN63024
2026-03-30 08:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419 with identifier: CN63024
2026-03-30 08:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419 with identifier: CN63024 to the API
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN63024>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:06:26Z',
 'fuel_type': 'petrol',
 'id': 'e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN63024',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 120969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_d20053720e43459591c16e5baced0cb5.jpg',
                'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_16387b37e5a509192a637a3ce0bdbda6.jpg',
                'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_bd6756a450b7f810322deb67638565c8.jpg',
                'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_24772525607ad76f49e587ff22d4829e.jpg',
                'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_3787ebfd482b033205ed13bbe66b3e18.jpg',
                'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_929b5afa0a8a2d11f47c367adfb439c3.jpg',
                'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_4137c897831016378c5b2b37ef64d1a4.jpg',
                'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_07c7b245b82cf3a4e3d22e23bee12b39.jpg',
                'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_5f65077909d952a7c619bba2b722a3c7.jpg',
                'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_42d10c28a70a7aee10946b02908fd0d5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419/e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_d20053720e43459591c16e5baced0cb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419/e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_16387b37e5a509192a637a3ce0bdbda6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419/e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_bd6756a450b7f810322deb67638565c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419/e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_24772525607ad76f49e587ff22d4829e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419/e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_3787ebfd482b033205ed13bbe66b3e18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419/e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_929b5afa0a8a2d11f47c367adfb439c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419/e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_4137c897831016378c5b2b37ef64d1a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419/e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_07c7b245b82cf3a4e3d22e23bee12b39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419/e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_5f65077909d952a7c619bba2b722a3c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419/e86dbdc2-bac2-50c3-ad4b-cfe7f18ea419_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ba/d0ba7c6abe69e5ac82eaeaecd66a43d1/pa/CN63024_42d10c28a70a7aee10946b02908fd0d5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN63024%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Saving data for CN63024: {'created_time': 1774859502.005894, 'last_price_update_time': 1774859502.005906, 'auction_closing_time': 1774969586.0}
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CN63024') HTTP/1.1" 204 0
2026-03-30 08:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: efb1b23b-941d-515f-804f-64ee546d9ae3 with identifier: GB22067
2026-03-30 08:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: efb1b23b-941d-515f-804f-64ee546d9ae3 with identifier: GB22067
2026-03-30 08:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: efb1b23b-941d-515f-804f-64ee546d9ae3 with identifier: GB22067 to the API
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:56:25Z',
 'fuel_type': 'petrol',
 'id': 'efb1b23b-941d-515f-804f-64ee546d9ae3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB22067',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 41896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB22067%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Saving data for GB22067: {'auction_closing_time': 1774886185.0, 'created_time': 1773137055.794892, 'last_price_update_time': 1774859502.329552}
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GB22067') HTTP/1.1" 204 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: GN69495
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN69495%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for GN69495: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: XD29708
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD29708%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for XD29708: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: SK35491
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK35491%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for SK35491: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: KT58942
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: UY87343
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: MH83966
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: DE26055
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE26055%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for DE26055: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: AD76625
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: ET26989
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET26989%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for ET26989: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: PF75414
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF75414%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for PF75414: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: WZ74297
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ74297%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for WZ74297: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: KR32592
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR32592%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for KR32592: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: WU68692
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU68692%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for WU68692: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: HX23250
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: DH89229
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: UZ99297
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: DZ79289
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: DX83468
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX83468%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for DX83468: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: ZY04103
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: EP64027
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD20873%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for SD20873: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: EN78807
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN78807%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for EN78807: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: SD10160
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: PZ32696
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: YA34487
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: RC41327
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: BL31735
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: PJ34917
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: TM16461
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC06950%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for PC06950: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN34238%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for JN34238: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: KD33371
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: ZM02853
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC87174%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for ZC87174: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: ZP04877
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: BY53413
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: GZ17047
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GZ17047%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for GZ17047: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: TN87621
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TN87621%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for TN87621: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: LY35485
2026-03-30 08:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ16156> (referer: https://www.auto1.com/v1/car-details-view/JJ16156/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_7e17255513f9ae1489fdb2280aa04960.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ49980%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for BJ49980: 0
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-30 08:31:42 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ18378%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [auto1.be] INFO: Scrape type for ZZ18378: 2
2026-03-30 08:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43944d2b-23cd-51d4-9a39-fc0d26fe588b with identifier: ZZ18378
2026-03-30 08:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43944d2b-23cd-51d4-9a39-fc0d26fe588b with scrape type 2
2026-03-30 08:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43944d2b-23cd-51d4-9a39-fc0d26fe588b with scrape type 2
2026-03-30 08:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43944d2b-23cd-51d4-9a39-fc0d26fe588b, identifier: ZZ18378
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_f4d2b4263e48c039bfc3429a58a80e84.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_f4d2b4263e48c039bfc3429a58a80e84.jpg not downloaded yet
2026-03-30 08:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_cbb08f2886b6fe5643f15a676085062b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43944d2b-23cd-51d4-9a39-fc0d26fe588b with identifier: ZZ18378
2026-03-30 08:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43944d2b-23cd-51d4-9a39-fc0d26fe588b with identifier: ZZ18378
2026-03-30 08:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43944d2b-23cd-51d4-9a39-fc0d26fe588b with identifier: ZZ18378 to the API
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:12:55Z',
 'fuel_type': 'diesel',
 'id': '43944d2b-23cd-51d4-9a39-fc0d26fe588b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ18378',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 243465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-15',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2016}
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ18378%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [auto1.be] INFO: Saving data for ZZ18378: {'auction_closing_time': 1774883575.0, 'created_time': 1774471035.016727, 'last_price_update_time': 1774859503.116583}
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ18378') HTTP/1.1" 204 0
2026-03-30 08:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7756d0>
2026-03-30 08:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_dcb4617edbdd55f5facdbdb045a9b0eb.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_dcb4617edbdd55f5facdbdb045a9b0eb.jpg saved to cache
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 996008fc-0532-52f9-a004-0c8ba0069e46
2026-03-30 08:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca6d3c90>
2026-03-30 08:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_500d9d86fdc2d18d05b1e8d82fad8fdd.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_500d9d86fdc2d18d05b1e8d82fad8fdd.jpg saved to cache
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 996008fc-0532-52f9-a004-0c8ba0069e46
2026-03-30 08:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fefb9d6d-8d41-526b-9a17-b83f81dd2ccf with identifier: VK40214
2026-03-30 08:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fefb9d6d-8d41-526b-9a17-b83f81dd2ccf with scrape type 1
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fefb9d6d-8d41-526b-9a17-b83f81dd2ccf
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F93%252F6293bd43542562d37eed39c646959060%252Fpa%252FVK40214_f9549ec0f8c78668c3d664ec2b9ba719.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_f9549ec0f8c78668c3d664ec2b9ba719.jpg already downloaded
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F93%252F6293bd43542562d37eed39c646959060%252Fpa%252FVK40214_c063c93504e15fd6c89de5834d36fd9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_c063c93504e15fd6c89de5834d36fd9f.jpg already downloaded
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F93%252F6293bd43542562d37eed39c646959060%252Fpa%252FVK40214_4069404426a9f759339df64cacaf4235.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_4069404426a9f759339df64cacaf4235.jpg already downloaded
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F93%252F6293bd43542562d37eed39c646959060%252Fpa%252FVK40214_4e3dccd80adcc5b5144045727ca110af.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_4e3dccd80adcc5b5144045727ca110af.jpg already downloaded
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F93%252F6293bd43542562d37eed39c646959060%252Fpa%252FVK40214_66618b476f152cde8dd8028aed0240f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_66618b476f152cde8dd8028aed0240f4.jpg already downloaded
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F93%252F6293bd43542562d37eed39c646959060%252Fpa%252FVK40214_4a90c11d60007717cea370c70f0fea38.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_4a90c11d60007717cea370c70f0fea38.jpg already downloaded
2026-03-30 08:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fefb9d6d-8d41-526b-9a17-b83f81dd2ccf, identifier: VK40214
2026-03-30 08:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc90a777-b1bc-5c84-8a4c-566fbe788522 with identifier: FG04950
2026-03-30 08:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc90a777-b1bc-5c84-8a4c-566fbe788522 with scrape type 1
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc90a777-b1bc-5c84-8a4c-566fbe788522
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_f6bae5a3a237db7634925efdd246c7b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_f6bae5a3a237db7634925efdd246c7b0.jpg not downloaded yet
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_57c294cb9c4dd9134c27eb62dc53733b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_57c294cb9c4dd9134c27eb62dc53733b.jpg not downloaded yet
2026-03-30 08:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA60978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fefb9d6d-8d41-526b-9a17-b83f81dd2ccf with identifier: VK40214
2026-03-30 08:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fefb9d6d-8d41-526b-9a17-b83f81dd2ccf with identifier: VK40214
2026-03-30 08:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fefb9d6d-8d41-526b-9a17-b83f81dd2ccf with identifier: VK40214 to the API
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VK40214>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:45:15Z',
 'fuel_type': 'diesel',
 'id': 'fefb9d6d-8d41-526b-9a17-b83f81dd2ccf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK40214',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 276259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_f9549ec0f8c78668c3d664ec2b9ba719.jpg',
                'https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_c063c93504e15fd6c89de5834d36fd9f.jpg',
                'https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_4069404426a9f759339df64cacaf4235.jpg',
                'https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_4e3dccd80adcc5b5144045727ca110af.jpg',
                'https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_66618b476f152cde8dd8028aed0240f4.jpg',
                'https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_4a90c11d60007717cea370c70f0fea38.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefb9d6d-8d41-526b-9a17-b83f81dd2ccf/fefb9d6d-8d41-526b-9a17-b83f81dd2ccf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_f9549ec0f8c78668c3d664ec2b9ba719.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefb9d6d-8d41-526b-9a17-b83f81dd2ccf/fefb9d6d-8d41-526b-9a17-b83f81dd2ccf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_c063c93504e15fd6c89de5834d36fd9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefb9d6d-8d41-526b-9a17-b83f81dd2ccf/fefb9d6d-8d41-526b-9a17-b83f81dd2ccf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_4069404426a9f759339df64cacaf4235.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefb9d6d-8d41-526b-9a17-b83f81dd2ccf/fefb9d6d-8d41-526b-9a17-b83f81dd2ccf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_4e3dccd80adcc5b5144045727ca110af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefb9d6d-8d41-526b-9a17-b83f81dd2ccf/fefb9d6d-8d41-526b-9a17-b83f81dd2ccf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_66618b476f152cde8dd8028aed0240f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefb9d6d-8d41-526b-9a17-b83f81dd2ccf/fefb9d6d-8d41-526b-9a17-b83f81dd2ccf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/93/6293bd43542562d37eed39c646959060/pa/VK40214_4a90c11d60007717cea370c70f0fea38.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V70 2.4 D Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2006}
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK40214%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [auto1.be] INFO: Saving data for VK40214: {'created_time': 1774859503.899433, 'last_price_update_time': 1774859503.899443, 'auction_closing_time': 1774971915.0}
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VK40214') HTTP/1.1" 204 0
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_aa7dee68c04f2ecf161808758d376803.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_aa7dee68c04f2ecf161808758d376803.jpg not downloaded yet
2026-03-30 08:31:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a20ab732-4676-5632-953f-e6ac51f02d5a with identifier: JJ16156
2026-03-30 08:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a20ab732-4676-5632-953f-e6ac51f02d5a with scrape type 1
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a20ab732-4676-5632-953f-e6ac51f02d5a
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F63%252Fe1635eb8e3bf97e456ebcca3dd36d3f3%252Fpa%252FJJ16156_fa1eba08b03ffc13cc9fe898826063e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_fa1eba08b03ffc13cc9fe898826063e1.jpg already downloaded
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F63%252Fe1635eb8e3bf97e456ebcca3dd36d3f3%252Fpa%252FJJ16156_25234a284c23d2f82b42669870d8f0a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_25234a284c23d2f82b42669870d8f0a6.jpg already downloaded
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F63%252Fe1635eb8e3bf97e456ebcca3dd36d3f3%252Fpa%252FJJ16156_78a5dc14c2e2c061636e2da5988701f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_78a5dc14c2e2c061636e2da5988701f5.jpg already downloaded
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F63%252Fe1635eb8e3bf97e456ebcca3dd36d3f3%252Fpa%252FJJ16156_f4470f02dc56c1559b305da9166331c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_f4470f02dc56c1559b305da9166331c7.jpg already downloaded
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F63%252Fe1635eb8e3bf97e456ebcca3dd36d3f3%252Fpa%252FJJ16156_36cbcba1fced6bb8956c890b1b80ae8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_36cbcba1fced6bb8956c890b1b80ae8c.jpg already downloaded
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F63%252Fe1635eb8e3bf97e456ebcca3dd36d3f3%252Fpa%252FJJ16156_34583d10b5a25957ce08e369fb61b85c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_34583d10b5a25957ce08e369fb61b85c.jpg already downloaded
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F63%252Fe1635eb8e3bf97e456ebcca3dd36d3f3%252Fpa%252FJJ16156_023313bfe8034fcd2a42afba00d0ee85.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_023313bfe8034fcd2a42afba00d0ee85.jpg already downloaded
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F63%252Fe1635eb8e3bf97e456ebcca3dd36d3f3%252Fpa%252FJJ16156_cce0268cfcf3798e0fc99c990a36af2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_cce0268cfcf3798e0fc99c990a36af2c.jpg already downloaded
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F63%252Fe1635eb8e3bf97e456ebcca3dd36d3f3%252Fpa%252FJJ16156_fc21907adabddec6425c4439ebe7581e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_fc21907adabddec6425c4439ebe7581e.jpg already downloaded
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F63%252Fe1635eb8e3bf97e456ebcca3dd36d3f3%252Fpa%252FJJ16156_407214b992c9b89fc568ee55d4b34491.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_407214b992c9b89fc568ee55d4b34491.jpg already downloaded
2026-03-30 08:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a20ab732-4676-5632-953f-e6ac51f02d5a, identifier: JJ16156
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca78b150>
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_7e17255513f9ae1489fdb2280aa04960.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_7e17255513f9ae1489fdb2280aa04960.jpg saved to cache
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 996008fc-0532-52f9-a004-0c8ba0069e46
2026-03-30 08:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_f44b0d691f1bac183a653bcd8c8476fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_46dd4863f5e1cd67ece4ff61757fa201.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_46dd4863f5e1cd67ece4ff61757fa201.jpg not downloaded yet
2026-03-30 08:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC80115> (referer: https://www.auto1.com/v1/car-details-view/GC80115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a20ab732-4676-5632-953f-e6ac51f02d5a with identifier: JJ16156
2026-03-30 08:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a20ab732-4676-5632-953f-e6ac51f02d5a with identifier: JJ16156
2026-03-30 08:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a20ab732-4676-5632-953f-e6ac51f02d5a with identifier: JJ16156 to the API
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JJ16156>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:10:56Z',
 'fuel_type': 'petrol',
 'id': 'a20ab732-4676-5632-953f-e6ac51f02d5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ16156',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 87504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_fa1eba08b03ffc13cc9fe898826063e1.jpg',
                'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_25234a284c23d2f82b42669870d8f0a6.jpg',
                'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_78a5dc14c2e2c061636e2da5988701f5.jpg',
                'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_f4470f02dc56c1559b305da9166331c7.jpg',
                'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_36cbcba1fced6bb8956c890b1b80ae8c.jpg',
                'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_34583d10b5a25957ce08e369fb61b85c.jpg',
                'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_023313bfe8034fcd2a42afba00d0ee85.jpg',
                'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_cce0268cfcf3798e0fc99c990a36af2c.jpg',
                'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_fc21907adabddec6425c4439ebe7581e.jpg',
                'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_407214b992c9b89fc568ee55d4b34491.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20ab732-4676-5632-953f-e6ac51f02d5a/a20ab732-4676-5632-953f-e6ac51f02d5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_fa1eba08b03ffc13cc9fe898826063e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20ab732-4676-5632-953f-e6ac51f02d5a/a20ab732-4676-5632-953f-e6ac51f02d5a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_25234a284c23d2f82b42669870d8f0a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20ab732-4676-5632-953f-e6ac51f02d5a/a20ab732-4676-5632-953f-e6ac51f02d5a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_78a5dc14c2e2c061636e2da5988701f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20ab732-4676-5632-953f-e6ac51f02d5a/a20ab732-4676-5632-953f-e6ac51f02d5a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_f4470f02dc56c1559b305da9166331c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20ab732-4676-5632-953f-e6ac51f02d5a/a20ab732-4676-5632-953f-e6ac51f02d5a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_36cbcba1fced6bb8956c890b1b80ae8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20ab732-4676-5632-953f-e6ac51f02d5a/a20ab732-4676-5632-953f-e6ac51f02d5a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_34583d10b5a25957ce08e369fb61b85c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20ab732-4676-5632-953f-e6ac51f02d5a/a20ab732-4676-5632-953f-e6ac51f02d5a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_023313bfe8034fcd2a42afba00d0ee85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20ab732-4676-5632-953f-e6ac51f02d5a/a20ab732-4676-5632-953f-e6ac51f02d5a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_cce0268cfcf3798e0fc99c990a36af2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20ab732-4676-5632-953f-e6ac51f02d5a/a20ab732-4676-5632-953f-e6ac51f02d5a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_fc21907adabddec6425c4439ebe7581e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20ab732-4676-5632-953f-e6ac51f02d5a/a20ab732-4676-5632-953f-e6ac51f02d5a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/63/e1635eb8e3bf97e456ebcca3dd36d3f3/pa/JJ16156_407214b992c9b89fc568ee55d4b34491.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2016}
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ16156%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [auto1.be] INFO: Saving data for JJ16156: {'created_time': 1774859504.643221, 'last_price_update_time': 1774859504.643235, 'auction_closing_time': 1774969856.0}
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ16156') HTTP/1.1" 204 0
2026-03-30 08:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_1aa5b5f744164950ab2d800b090b2a59.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_9f60d25de614699d0bcda3240b2e9bec.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_9f60d25de614699d0bcda3240b2e9bec.jpg not downloaded yet
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9614050>
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_cbb08f2886b6fe5643f15a676085062b.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_cbb08f2886b6fe5643f15a676085062b.jpg saved to cache
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 996008fc-0532-52f9-a004-0c8ba0069e46
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_5d8b6b89a889401a6e70e59b6bc4d1e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_5d8b6b89a889401a6e70e59b6bc4d1e1.jpg not downloaded yet
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_25db70bfb8e8e8b6733674f9429d89d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_25db70bfb8e8e8b6733674f9429d89d4.jpg not downloaded yet
2026-03-30 08:31:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9431f50>
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_f44b0d691f1bac183a653bcd8c8476fc.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_f44b0d691f1bac183a653bcd8c8476fc.jpg saved to cache
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 996008fc-0532-52f9-a004-0c8ba0069e46
2026-03-30 08:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2e4d67c-9293-5fa3-a18a-eb76845fb220 with identifier: GC80115
2026-03-30 08:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2e4d67c-9293-5fa3-a18a-eb76845fb220 with scrape type 1
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2e4d67c-9293-5fa3-a18a-eb76845fb220
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_0d20a9591889bdfce1321a59086dd4dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_0d20a9591889bdfce1321a59086dd4dc.jpg not downloaded yet
2026-03-30 08:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_f6bae5a3a237db7634925efdd246c7b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_d666b170296569172de17565081d4418.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_d666b170296569172de17565081d4418.jpg not downloaded yet
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_45eb2670b85581e938fac8bccb3263c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_45eb2670b85581e938fac8bccb3263c2.jpg not downloaded yet
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca776f50>
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_1aa5b5f744164950ab2d800b090b2a59.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_1aa5b5f744164950ab2d800b090b2a59.jpg saved to cache
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 996008fc-0532-52f9-a004-0c8ba0069e46
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_41527522393a1796a508cdb1f215e42b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_41527522393a1796a508cdb1f215e42b.jpg not downloaded yet
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_fb720147960da0599f8b0f0aa89569a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_fb720147960da0599f8b0f0aa89569a3.jpg not downloaded yet
2026-03-30 08:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_f4d2b4263e48c039bfc3429a58a80e84.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_9f60d25de614699d0bcda3240b2e9bec.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_57c294cb9c4dd9134c27eb62dc53733b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_aa7dee68c04f2ecf161808758d376803.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_f6478b9502afdca0f9bf6450bee817b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_f6478b9502afdca0f9bf6450bee817b8.jpg not downloaded yet
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_48576f64fc6a3d7df0dedd8d19c540ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_48576f64fc6a3d7df0dedd8d19c540ff.jpg not downloaded yet
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c93e8510>
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_f6bae5a3a237db7634925efdd246c7b0.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_f6bae5a3a237db7634925efdd246c7b0.jpg saved to cache
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc90a777-b1bc-5c84-8a4c-566fbe788522
2026-03-30 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_fbe1b8f1fee1238462382fe3a908f7b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_5e1f4d606ede14edb4e732ce38a5a9c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_5e1f4d606ede14edb4e732ce38a5a9c5.jpg not downloaded yet
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_93de00993e1cb8991bd496635fa0a38e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_93de00993e1cb8991bd496635fa0a38e.jpg not downloaded yet
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_183aa3f97c946a0156306610511edcff.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_183aa3f97c946a0156306610511edcff.jpg not downloaded yet
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_72f7f1698e29fb186bb6e515dcadff00.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_72f7f1698e29fb186bb6e515dcadff00.jpg not downloaded yet
2026-03-30 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_46dd4863f5e1cd67ece4ff61757fa201.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_5d8b6b89a889401a6e70e59b6bc4d1e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_45eb2670b85581e938fac8bccb3263c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_25db70bfb8e8e8b6733674f9429d89d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_ebd4a4e70b2b52687858b496a05c482b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_ebd4a4e70b2b52687858b496a05c482b.jpg not downloaded yet
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_d340ed7fc99dbcf5424d02ab3eeabc1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_d340ed7fc99dbcf5424d02ab3eeabc1f.jpg not downloaded yet
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca797210>
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_f4d2b4263e48c039bfc3429a58a80e84.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_f4d2b4263e48c039bfc3429a58a80e84.jpg saved to cache
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 996008fc-0532-52f9-a004-0c8ba0069e46
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca711ad0>
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_9f60d25de614699d0bcda3240b2e9bec.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_9f60d25de614699d0bcda3240b2e9bec.jpg saved to cache
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc90a777-b1bc-5c84-8a4c-566fbe788522
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca6df9d0>
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_57c294cb9c4dd9134c27eb62dc53733b.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_57c294cb9c4dd9134c27eb62dc53733b.jpg saved to cache
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 996008fc-0532-52f9-a004-0c8ba0069e46
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c94bec90>
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_aa7dee68c04f2ecf161808758d376803.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_aa7dee68c04f2ecf161808758d376803.jpg saved to cache
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc90a777-b1bc-5c84-8a4c-566fbe788522
2026-03-30 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_fb720147960da0599f8b0f0aa89569a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_0d20a9591889bdfce1321a59086dd4dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_c24b3d30b2489d6613f95c6bfcdba4c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_c24b3d30b2489d6613f95c6bfcdba4c6.jpg not downloaded yet
2026-03-30 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_d666b170296569172de17565081d4418.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF38996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_19a450b7e5324c9d23dc08c353075037.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_19a450b7e5324c9d23dc08c353075037.jpg not downloaded yet
2026-03-30 08:31:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca76f390>
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F94%252F1894f48976230a869e60aa9e4d7decdc%252Fpa%252FRH39924_fbe1b8f1fee1238462382fe3a908f7b1.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_fbe1b8f1fee1238462382fe3a908f7b1.jpg saved to cache
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e16c549f-c68b-593c-887b-d1f47a4cba88
2026-03-30 08:31:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e16c549f-c68b-593c-887b-d1f47a4cba88, skipping ID generation
2026-03-30 08:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e16c549f-c68b-593c-887b-d1f47a4cba88 with scrape type 1
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e16c549f-c68b-593c-887b-d1f47a4cba88 sending to next pipeline
2026-03-30 08:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e16c549f-c68b-593c-887b-d1f47a4cba88, identifier: RH39924
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6cc81b710>
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_46dd4863f5e1cd67ece4ff61757fa201.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_46dd4863f5e1cd67ece4ff61757fa201.jpg saved to cache
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 996008fc-0532-52f9-a004-0c8ba0069e46
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c95d1b10>
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2b%252Fcf2b41ba70827c963ed928db26cb5877%252Fpa%252FAE99564_5d8b6b89a889401a6e70e59b6bc4d1e1.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_5d8b6b89a889401a6e70e59b6bc4d1e1.jpg saved to cache
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 996008fc-0532-52f9-a004-0c8ba0069e46
2026-03-30 08:31:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 996008fc-0532-52f9-a004-0c8ba0069e46, skipping ID generation
2026-03-30 08:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 996008fc-0532-52f9-a004-0c8ba0069e46 with scrape type 1
2026-03-30 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 996008fc-0532-52f9-a004-0c8ba0069e46 sending to next pipeline
2026-03-30 08:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 996008fc-0532-52f9-a004-0c8ba0069e46, identifier: AE99564
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9576290>
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_45eb2670b85581e938fac8bccb3263c2.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_45eb2670b85581e938fac8bccb3263c2.jpg saved to cache
2026-03-30 08:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2e4d67c-9293-5fa3-a18a-eb76845fb220
2026-03-30 08:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca89c650>
2026-03-30 08:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_25db70bfb8e8e8b6733674f9429d89d4.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_25db70bfb8e8e8b6733674f9429d89d4.jpg saved to cache
2026-03-30 08:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc90a777-b1bc-5c84-8a4c-566fbe788522
2026-03-30 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_a138726e782a851003c3d043e23ef931.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_7f0d50fe388cbaa2acec83d105cc68ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_7f0d50fe388cbaa2acec83d105cc68ea.jpg not downloaded yet
2026-03-30 08:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e16c549f-c68b-593c-887b-d1f47a4cba88 with identifier: RH39924
2026-03-30 08:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e16c549f-c68b-593c-887b-d1f47a4cba88 with identifier: RH39924
2026-03-30 08:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e16c549f-c68b-593c-887b-d1f47a4cba88 with identifier: RH39924 to the API
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_fbe1b8f1fee1238462382fe3a908f7b1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 82,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.8L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:26:19Z',
 'fuel_type': 'hybrid',
 'id': 'e16c549f-c68b-593c-887b-d1f47a4cba88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH39924',
 'listing': 'auction',
 'location': 'BE, SAINT-MARC',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 178800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_902c14dc1ecaebc72c7183b6703c5449.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370652,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_79105ee5ecc93ebca5fca4807addedaf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_1b36ab2ccac194716483d8a1eef89815.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_60436cd1c30e863ddf0957fda2db9f8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374585,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_5a26e2a329396b7ab31fa533224872a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_7e8dd2051514f64e049d8664ab7fb7e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2492103,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_fbe1b8f1fee1238462382fe3a908f7b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_7477bc6dd25ade678fe9dae314c83c1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375043,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_561123e55d7b57adf857239bfb002a33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e16c549f-c68b-593c-887b-d1f47a4cba88/e16c549f-c68b-593c-887b-d1f47a4cba88_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363566,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/94/1894f48976230a869e60aa9e4d7decdc/pa/RH39924_536510e5c2d63482ff1c51b7b8638449.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.8 Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2016}
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH39924%27 HTTP/1.1" 200 None
2026-03-30 08:31:46 [auto1.be] INFO: Saving data for RH39924: {'created_time': 1774859506.508571, 'last_price_update_time': 1774859506.508581, 'auction_closing_time': 1774970779.0}
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RH39924') HTTP/1.1" 204 0
2026-03-30 08:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 996008fc-0532-52f9-a004-0c8ba0069e46 with identifier: AE99564
2026-03-30 08:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 996008fc-0532-52f9-a004-0c8ba0069e46 with identifier: AE99564
2026-03-30 08:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 996008fc-0532-52f9-a004-0c8ba0069e46 with identifier: AE99564 to the API
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_5d8b6b89a889401a6e70e59b6bc4d1e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:19:35Z',
 'fuel_type': 'diesel',
 'id': '996008fc-0532-52f9-a004-0c8ba0069e46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE99564',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 125118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_dcb4617edbdd55f5facdbdb045a9b0eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_500d9d86fdc2d18d05b1e8d82fad8fdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_7e17255513f9ae1489fdb2280aa04960.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_cbb08f2886b6fe5643f15a676085062b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_f44b0d691f1bac183a653bcd8c8476fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_1aa5b5f744164950ab2d800b090b2a59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_f4d2b4263e48c039bfc3429a58a80e84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_57c294cb9c4dd9134c27eb62dc53733b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_46dd4863f5e1cd67ece4ff61757fa201.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_996008fc-0532-52f9-a004-0c8ba0069e46/996008fc-0532-52f9-a004-0c8ba0069e46_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2b/cf2b41ba70827c963ed928db26cb5877/pa/AE99564_5d8b6b89a889401a6e70e59b6bc4d1e1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 300 L1 Trend',
 'transmission': 'automatic',
 'trim': '300 L1 Trend',
 'year': 2019}
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE99564%27 HTTP/1.1" 200 None
2026-03-30 08:31:46 [auto1.be] INFO: Saving data for AE99564: {'created_time': 1774859506.912208, 'last_price_update_time': 1774859506.91222, 'auction_closing_time': 1774970375.0}
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AE99564') HTTP/1.1" 204 0
2026-03-30 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_f6478b9502afdca0f9bf6450bee817b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_5e1f4d606ede14edb4e732ce38a5a9c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_93de00993e1cb8991bd496635fa0a38e.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_72f7f1698e29fb186bb6e515dcadff00.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_48576f64fc6a3d7df0dedd8d19c540ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_41527522393a1796a508cdb1f215e42b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_183aa3f97c946a0156306610511edcff.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH13121> (referer: https://www.auto1.com/v1/car-details-view/PH13121/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA60978> (referer: https://www.auto1.com/v1/car-details-view/JA60978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9514290>
2026-03-30 08:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_fb720147960da0599f8b0f0aa89569a3.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_fb720147960da0599f8b0f0aa89569a3.jpg saved to cache
2026-03-30 08:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2e4d67c-9293-5fa3-a18a-eb76845fb220
2026-03-30 08:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca8aea10>
2026-03-30 08:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_0d20a9591889bdfce1321a59086dd4dc.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_0d20a9591889bdfce1321a59086dd4dc.jpg saved to cache
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2e4d67c-9293-5fa3-a18a-eb76845fb220
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca6dc1d0>
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_d666b170296569172de17565081d4418.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_d666b170296569172de17565081d4418.jpg saved to cache
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc90a777-b1bc-5c84-8a4c-566fbe788522
2026-03-30 08:31:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca89d650>
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F20%252F3c20a667ae4b26f51124e63fb17c697f%252Fpa%252FZV23610_a138726e782a851003c3d043e23ef931.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_a138726e782a851003c3d043e23ef931.jpg saved to cache
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9
2026-03-30 08:31:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9, skipping ID generation
2026-03-30 08:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9 with scrape type 1
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9 sending to next pipeline
2026-03-30 08:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9, identifier: ZV23610
2026-03-30 08:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9 with identifier: ZV23610
2026-03-30 08:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9 with identifier: ZV23610
2026-03-30 08:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9 with identifier: ZV23610 to the API
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_a138726e782a851003c3d043e23ef931.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 325,
 'expiration_date': '2026-03-31T15:47:06Z',
 'fuel_type': 'petrol',
 'id': 'eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV23610',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'BMW',
 'model': '7er',
 'odometer': 241926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_4da5a53cb024ced10a105f1fb41236b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2826335,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_b48da29b6dcb9cc3e526a76c54711e46.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_64c5f54018adbe912d33affd7acc33f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_acec55e09ed55cb844223feda6c5c042.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2500768,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_7a50f3968ac47a2b86d64e06446020a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_c7efb9d387f6d0ad31d0644b5fa79101.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_098ce00f52606d0a951c3b355f47e4f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2632200,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_7a6ffe488ac15dbb728d654ad0ce93f0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_880588fbcf2d443ec0dc93b310b3334d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9/eeb71e8e-bb28-563e-8287-b7ce8e4d8cc9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2571706,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/20/3c20a667ae4b26f51124e63fb17c697f/pa/ZV23610_a138726e782a851003c3d043e23ef931.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 7er 740i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV23610%27 HTTP/1.1" 200 None
2026-03-30 08:31:47 [auto1.be] INFO: Saving data for ZV23610: {'created_time': 1774859507.741249, 'last_price_update_time': 1774859507.741261, 'auction_closing_time': 1774972026.0}
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZV23610') HTTP/1.1" 204 0
2026-03-30 08:31:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_ebd4a4e70b2b52687858b496a05c482b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_d340ed7fc99dbcf5424d02ab3eeabc1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_c24b3d30b2489d6613f95c6bfcdba4c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c95de190>
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_f6478b9502afdca0f9bf6450bee817b8.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_f6478b9502afdca0f9bf6450bee817b8.jpg saved to cache
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc90a777-b1bc-5c84-8a4c-566fbe788522
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9506a10>
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_5e1f4d606ede14edb4e732ce38a5a9c5.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_5e1f4d606ede14edb4e732ce38a5a9c5.jpg saved to cache
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc90a777-b1bc-5c84-8a4c-566fbe788522
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c945fb10>
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_93de00993e1cb8991bd496635fa0a38e.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_93de00993e1cb8991bd496635fa0a38e.jpg saved to cache
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2e4d67c-9293-5fa3-a18a-eb76845fb220
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c931c810>
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_72f7f1698e29fb186bb6e515dcadff00.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_72f7f1698e29fb186bb6e515dcadff00.jpg saved to cache
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2e4d67c-9293-5fa3-a18a-eb76845fb220
2026-03-30 08:31:47 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1492 | hits on page: 40
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c932f9d0>
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_48576f64fc6a3d7df0dedd8d19c540ff.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_48576f64fc6a3d7df0dedd8d19c540ff.jpg saved to cache
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2e4d67c-9293-5fa3-a18a-eb76845fb220
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c921d110>
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_41527522393a1796a508cdb1f215e42b.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_41527522393a1796a508cdb1f215e42b.jpg saved to cache
2026-03-30 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc90a777-b1bc-5c84-8a4c-566fbe788522
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c921cb10>
2026-03-30 08:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_183aa3f97c946a0156306610511edcff.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_183aa3f97c946a0156306610511edcff.jpg saved to cache
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc90a777-b1bc-5c84-8a4c-566fbe788522
2026-03-30 08:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8561d9f2-eef1-58d9-b9b3-754ec7c3adda with identifier: PH13121
2026-03-30 08:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8561d9f2-eef1-58d9-b9b3-754ec7c3adda with scrape type 1
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8561d9f2-eef1-58d9-b9b3-754ec7c3adda
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F85%252Fd38573fbf3b26ea11b6f4d6fcc357de9%252Fpa%252FPH13121_8ba2631afd7be0e42e03be090fe7e350.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_8ba2631afd7be0e42e03be090fe7e350.jpg not downloaded yet
2026-03-30 08:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53001180-a1dd-50cb-8adb-eae6220cdd89 with identifier: JA60978
2026-03-30 08:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53001180-a1dd-50cb-8adb-eae6220cdd89 with scrape type 1
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53001180-a1dd-50cb-8adb-eae6220cdd89
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F29%252Fba29068532377d58946991a4ceab6a65%252Fpa%252FJA60978_4042d6be49eee2d02275c1cd7ba44c2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_4042d6be49eee2d02275c1cd7ba44c2f.jpg already downloaded
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F29%252Fba29068532377d58946991a4ceab6a65%252Fpa%252FJA60978_d1b6b600ebd35576f66c028db996a047.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_d1b6b600ebd35576f66c028db996a047.jpg already downloaded
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F29%252Fba29068532377d58946991a4ceab6a65%252Fpa%252FJA60978_2a571601f493f0f2fbf4e420011eef6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_2a571601f493f0f2fbf4e420011eef6f.jpg not downloaded yet
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: DP17314
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP17314%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for DP17314: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: KU68109
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT61211%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for WT61211: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: RG41014
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG41014%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for RG41014: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: VL25326
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH78267%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for PH78267: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: GA47341
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA47341%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for GA47341: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: NL54460
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL54460%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for NL54460: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: MM05603
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM05603%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for MM05603: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: MT15926
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT15926%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for MT15926: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: GB86339
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB86339%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for GB86339: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: PW41553
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW41553%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for PW41553: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for FF69776: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: BY20726
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: YH64614
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH64614%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for YH64614: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: KF56069
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: BT87712
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT87712%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for BT87712: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: BV02466
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: SY52065
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: NC51382
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC51382%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for NC51382: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: NG60197
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU40393%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for XU40393: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: JU27695
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU27695%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for JU27695: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: YR77899
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH50113%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for FH50113: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: VM31149
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM31149%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for VM31149: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: JC67757
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC67757%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for JC67757: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: UA36767
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: WA86347
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: PS31946
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: DY35896
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY35896%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for DY35896: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: VM01272
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM01272%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for VM01272: 0
2026-03-30 08:31:48 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL42374%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [auto1.be] INFO: Scrape type for KL42374: 0
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F85%252Fd38573fbf3b26ea11b6f4d6fcc357de9%252Fpa%252FPH13121_971cb28ac7d72652e739dfe0f79b3b49.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_971cb28ac7d72652e739dfe0f79b3b49.jpg not downloaded yet
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F29%252Fba29068532377d58946991a4ceab6a65%252Fpa%252FJA60978_b6a5f6450b271e6141a96369a5108eee.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_b6a5f6450b271e6141a96369a5108eee.jpg already downloaded
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F29%252Fba29068532377d58946991a4ceab6a65%252Fpa%252FJA60978_7ef64f0ab382f646c06068aebe4e646a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_7ef64f0ab382f646c06068aebe4e646a.jpg already downloaded
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F29%252Fba29068532377d58946991a4ceab6a65%252Fpa%252FJA60978_68535c04cfdcb0b3c86c65ab67bc8c12.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_68535c04cfdcb0b3c86c65ab67bc8c12.jpg already downloaded
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F29%252Fba29068532377d58946991a4ceab6a65%252Fpa%252FJA60978_bec96989f2873bf13f34b8150caa0056.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_bec96989f2873bf13f34b8150caa0056.jpg already downloaded
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F29%252Fba29068532377d58946991a4ceab6a65%252Fpa%252FJA60978_25c6864995cff659159a4ffa89440901.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_25c6864995cff659159a4ffa89440901.jpg already downloaded
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F29%252Fba29068532377d58946991a4ceab6a65%252Fpa%252FJA60978_b1e85afa91d61952110ad605bd3babab.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_b1e85afa91d61952110ad605bd3babab.jpg not downloaded yet
2026-03-30 08:31:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_19a450b7e5324c9d23dc08c353075037.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_7f0d50fe388cbaa2acec83d105cc68ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F85%252Fd38573fbf3b26ea11b6f4d6fcc357de9%252Fpa%252FPH13121_a7b553c6ffae3aef45cebe70b19c6750.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_a7b553c6ffae3aef45cebe70b19c6750.jpg not downloaded yet
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F29%252Fba29068532377d58946991a4ceab6a65%252Fpa%252FJA60978_4eda1f3797c07a1f4b5d8b33ee879dc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_4eda1f3797c07a1f4b5d8b33ee879dc4.jpg not downloaded yet
2026-03-30 08:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7e2310>
2026-03-30 08:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2083a575cf54549a27169a5c356eebc%252Fpa%252FFG04950_ebd4a4e70b2b52687858b496a05c482b.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_ebd4a4e70b2b52687858b496a05c482b.jpg saved to cache
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc90a777-b1bc-5c84-8a4c-566fbe788522
2026-03-30 08:31:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc90a777-b1bc-5c84-8a4c-566fbe788522, skipping ID generation
2026-03-30 08:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc90a777-b1bc-5c84-8a4c-566fbe788522 with scrape type 1
2026-03-30 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc90a777-b1bc-5c84-8a4c-566fbe788522 sending to next pipeline
2026-03-30 08:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bc90a777-b1bc-5c84-8a4c-566fbe788522, identifier: FG04950
2026-03-30 08:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6cca36610>
2026-03-30 08:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_d340ed7fc99dbcf5424d02ab3eeabc1f.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_d340ed7fc99dbcf5424d02ab3eeabc1f.jpg saved to cache
2026-03-30 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2e4d67c-9293-5fa3-a18a-eb76845fb220
2026-03-30 08:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c93e2b90>
2026-03-30 08:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_c24b3d30b2489d6613f95c6bfcdba4c6.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_c24b3d30b2489d6613f95c6bfcdba4c6.jpg saved to cache
2026-03-30 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2e4d67c-9293-5fa3-a18a-eb76845fb220
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F85%252Fd38573fbf3b26ea11b6f4d6fcc357de9%252Fpa%252FPH13121_898348e5455d8474e3a1b6b0d20d499b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_898348e5455d8474e3a1b6b0d20d499b.jpg not downloaded yet
2026-03-30 08:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bc90a777-b1bc-5c84-8a4c-566fbe788522 with identifier: FG04950
2026-03-30 08:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bc90a777-b1bc-5c84-8a4c-566fbe788522 with identifier: FG04950
2026-03-30 08:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bc90a777-b1bc-5c84-8a4c-566fbe788522 with identifier: FG04950 to the API
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_ebd4a4e70b2b52687858b496a05c482b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:07:16Z',
 'fuel_type': 'diesel',
 'id': 'bc90a777-b1bc-5c84-8a4c-566fbe788522',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG04950',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 167700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_f6bae5a3a237db7634925efdd246c7b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_aa7dee68c04f2ecf161808758d376803.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_9f60d25de614699d0bcda3240b2e9bec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_25db70bfb8e8e8b6733674f9429d89d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_d666b170296569172de17565081d4418.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_41527522393a1796a508cdb1f215e42b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_f6478b9502afdca0f9bf6450bee817b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_5e1f4d606ede14edb4e732ce38a5a9c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_183aa3f97c946a0156306610511edcff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc90a777-b1bc-5c84-8a4c-566fbe788522/bc90a777-b1bc-5c84-8a4c-566fbe788522_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2083a575cf54549a27169a5c356eebc/pa/FG04950_ebd4a4e70b2b52687858b496a05c482b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG04950%27 HTTP/1.1" 200 None
2026-03-30 08:31:49 [auto1.be] INFO: Saving data for FG04950: {'created_time': 1774859509.489703, 'last_price_update_time': 1774859509.489715, 'auction_closing_time': 1774969636.0}
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FG04950') HTTP/1.1" 204 0
2026-03-30 08:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_8ba2631afd7be0e42e03be090fe7e350.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_2a571601f493f0f2fbf4e420011eef6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F85%252Fd38573fbf3b26ea11b6f4d6fcc357de9%252Fpa%252FPH13121_d98a68ae34a6c5e81b67c2cf41ec2b5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_d98a68ae34a6c5e81b67c2cf41ec2b5b.jpg not downloaded yet
2026-03-30 08:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7ca190>
2026-03-30 08:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_19a450b7e5324c9d23dc08c353075037.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_19a450b7e5324c9d23dc08c353075037.jpg saved to cache
2026-03-30 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2e4d67c-9293-5fa3-a18a-eb76845fb220
2026-03-30 08:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca6afbd0>
2026-03-30 08:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F19%252Fbd19e3aefe394f16e8fa1c7dadf98891%252Fpa%252FGC80115_7f0d50fe388cbaa2acec83d105cc68ea.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_7f0d50fe388cbaa2acec83d105cc68ea.jpg saved to cache
2026-03-30 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2e4d67c-9293-5fa3-a18a-eb76845fb220
2026-03-30 08:31:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2e4d67c-9293-5fa3-a18a-eb76845fb220, skipping ID generation
2026-03-30 08:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2e4d67c-9293-5fa3-a18a-eb76845fb220 with scrape type 1
2026-03-30 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2e4d67c-9293-5fa3-a18a-eb76845fb220 sending to next pipeline
2026-03-30 08:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f2e4d67c-9293-5fa3-a18a-eb76845fb220, identifier: GC80115
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F85%252Fd38573fbf3b26ea11b6f4d6fcc357de9%252Fpa%252FPH13121_c442cc85fca36385d5dc16f35b5d9ad3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_c442cc85fca36385d5dc16f35b5d9ad3.jpg not downloaded yet
2026-03-30 08:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f2e4d67c-9293-5fa3-a18a-eb76845fb220 with identifier: GC80115
2026-03-30 08:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f2e4d67c-9293-5fa3-a18a-eb76845fb220 with identifier: GC80115
2026-03-30 08:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f2e4d67c-9293-5fa3-a18a-eb76845fb220 with identifier: GC80115 to the API
2026-03-30 08:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_7f0d50fe388cbaa2acec83d105cc68ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:29:02Z',
 'fuel_type': 'diesel',
 'id': 'f2e4d67c-9293-5fa3-a18a-eb76845fb220',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC80115',
 'listing': 'auction',
 'location': 'BE',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 196756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_0d20a9591889bdfce1321a59086dd4dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_45eb2670b85581e938fac8bccb3263c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_fb720147960da0599f8b0f0aa89569a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_48576f64fc6a3d7df0dedd8d19c540ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_93de00993e1cb8991bd496635fa0a38e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_72f7f1698e29fb186bb6e515dcadff00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_d340ed7fc99dbcf5424d02ab3eeabc1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_c24b3d30b2489d6613f95c6bfcdba4c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_19a450b7e5324c9d23dc08c353075037.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e4d67c-9293-5fa3-a18a-eb76845fb220/f2e4d67c-9293-5fa3-a18a-eb76845fb220_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/19/bd19e3aefe394f16e8fa1c7dadf98891/pa/GC80115_7f0d50fe388cbaa2acec83d105cc68ea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cabrio Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC80115%27 HTTP/1.1" 200 None
2026-03-30 08:31:50 [auto1.be] INFO: Saving data for GC80115: {'created_time': 1774859510.229371, 'last_price_update_time': 1774859510.229382, 'auction_closing_time': 1774970942.0}
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GC80115') HTTP/1.1" 204 0
2026-03-30 08:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_971cb28ac7d72652e739dfe0f79b3b49.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_a7b553c6ffae3aef45cebe70b19c6750.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_4eda1f3797c07a1f4b5d8b33ee879dc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_b1e85afa91d61952110ad605bd3babab.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca8a8910>
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8561d9f2-eef1-58d9-b9b3-754ec7c3adda/8561d9f2-eef1-58d9-b9b3-754ec7c3adda_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F85%252Fd38573fbf3b26ea11b6f4d6fcc357de9%252Fpa%252FPH13121_8ba2631afd7be0e42e03be090fe7e350.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_8ba2631afd7be0e42e03be090fe7e350.jpg saved to cache
2026-03-30 08:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8561d9f2-eef1-58d9-b9b3-754ec7c3adda
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca78bf50>
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53001180-a1dd-50cb-8adb-eae6220cdd89/53001180-a1dd-50cb-8adb-eae6220cdd89_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F29%252Fba29068532377d58946991a4ceab6a65%252Fpa%252FJA60978_2a571601f493f0f2fbf4e420011eef6f.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_2a571601f493f0f2fbf4e420011eef6f.jpg saved to cache
2026-03-30 08:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53001180-a1dd-50cb-8adb-eae6220cdd89
2026-03-30 08:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_898348e5455d8474e3a1b6b0d20d499b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7821d0>
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8561d9f2-eef1-58d9-b9b3-754ec7c3adda/8561d9f2-eef1-58d9-b9b3-754ec7c3adda_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F85%252Fd38573fbf3b26ea11b6f4d6fcc357de9%252Fpa%252FPH13121_971cb28ac7d72652e739dfe0f79b3b49.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_971cb28ac7d72652e739dfe0f79b3b49.jpg saved to cache
2026-03-30 08:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8561d9f2-eef1-58d9-b9b3-754ec7c3adda
2026-03-30 08:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_d98a68ae34a6c5e81b67c2cf41ec2b5b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca6ae950>
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8561d9f2-eef1-58d9-b9b3-754ec7c3adda/8561d9f2-eef1-58d9-b9b3-754ec7c3adda_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F85%252Fd38573fbf3b26ea11b6f4d6fcc357de9%252Fpa%252FPH13121_a7b553c6ffae3aef45cebe70b19c6750.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_a7b553c6ffae3aef45cebe70b19c6750.jpg saved to cache
2026-03-30 08:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8561d9f2-eef1-58d9-b9b3-754ec7c3adda
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c95302d0>
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53001180-a1dd-50cb-8adb-eae6220cdd89/53001180-a1dd-50cb-8adb-eae6220cdd89_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F29%252Fba29068532377d58946991a4ceab6a65%252Fpa%252FJA60978_4eda1f3797c07a1f4b5d8b33ee879dc4.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_4eda1f3797c07a1f4b5d8b33ee879dc4.jpg saved to cache
2026-03-30 08:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53001180-a1dd-50cb-8adb-eae6220cdd89
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca6d7250>
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53001180-a1dd-50cb-8adb-eae6220cdd89/53001180-a1dd-50cb-8adb-eae6220cdd89_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F29%252Fba29068532377d58946991a4ceab6a65%252Fpa%252FJA60978_b1e85afa91d61952110ad605bd3babab.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_b1e85afa91d61952110ad605bd3babab.jpg saved to cache
2026-03-30 08:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53001180-a1dd-50cb-8adb-eae6220cdd89
2026-03-30 08:31:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53001180-a1dd-50cb-8adb-eae6220cdd89, skipping ID generation
2026-03-30 08:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53001180-a1dd-50cb-8adb-eae6220cdd89 with scrape type 1
2026-03-30 08:31:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53001180-a1dd-50cb-8adb-eae6220cdd89 sending to next pipeline
2026-03-30 08:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 53001180-a1dd-50cb-8adb-eae6220cdd89, identifier: JA60978
2026-03-30 08:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 53001180-a1dd-50cb-8adb-eae6220cdd89 with identifier: JA60978
2026-03-30 08:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 53001180-a1dd-50cb-8adb-eae6220cdd89 with identifier: JA60978
2026-03-30 08:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 53001180-a1dd-50cb-8adb-eae6220cdd89 with identifier: JA60978 to the API
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_b1e85afa91d61952110ad605bd3babab.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:21:15Z',
 'fuel_type': 'petrol',
 'id': '53001180-a1dd-50cb-8adb-eae6220cdd89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA60978',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 198269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 44,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53001180-a1dd-50cb-8adb-eae6220cdd89/53001180-a1dd-50cb-8adb-eae6220cdd89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_4042d6be49eee2d02275c1cd7ba44c2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53001180-a1dd-50cb-8adb-eae6220cdd89/53001180-a1dd-50cb-8adb-eae6220cdd89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_d1b6b600ebd35576f66c028db996a047.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53001180-a1dd-50cb-8adb-eae6220cdd89/53001180-a1dd-50cb-8adb-eae6220cdd89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_2a571601f493f0f2fbf4e420011eef6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53001180-a1dd-50cb-8adb-eae6220cdd89/53001180-a1dd-50cb-8adb-eae6220cdd89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_b6a5f6450b271e6141a96369a5108eee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53001180-a1dd-50cb-8adb-eae6220cdd89/53001180-a1dd-50cb-8adb-eae6220cdd89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_7ef64f0ab382f646c06068aebe4e646a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53001180-a1dd-50cb-8adb-eae6220cdd89/53001180-a1dd-50cb-8adb-eae6220cdd89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_68535c04cfdcb0b3c86c65ab67bc8c12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53001180-a1dd-50cb-8adb-eae6220cdd89/53001180-a1dd-50cb-8adb-eae6220cdd89_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_bec96989f2873bf13f34b8150caa0056.jpg',
             'Width': 782},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53001180-a1dd-50cb-8adb-eae6220cdd89/53001180-a1dd-50cb-8adb-eae6220cdd89_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_25c6864995cff659159a4ffa89440901.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53001180-a1dd-50cb-8adb-eae6220cdd89/53001180-a1dd-50cb-8adb-eae6220cdd89_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_b1e85afa91d61952110ad605bd3babab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53001180-a1dd-50cb-8adb-eae6220cdd89/53001180-a1dd-50cb-8adb-eae6220cdd89_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/29/ba29068532377d58946991a4ceab6a65/pa/JA60978_4eda1f3797c07a1f4b5d8b33ee879dc4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA60978%27 HTTP/1.1" 200 None
2026-03-30 08:31:50 [auto1.be] INFO: Saving data for JA60978: {'created_time': 1774859510.956485, 'last_price_update_time': 1774859510.956495, 'auction_closing_time': 1774970475.0}
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JA60978') HTTP/1.1" 204 0
2026-03-30 08:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_c442cc85fca36385d5dc16f35b5d9ad3.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7ff750>
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8561d9f2-eef1-58d9-b9b3-754ec7c3adda/8561d9f2-eef1-58d9-b9b3-754ec7c3adda_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F85%252Fd38573fbf3b26ea11b6f4d6fcc357de9%252Fpa%252FPH13121_898348e5455d8474e3a1b6b0d20d499b.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_898348e5455d8474e3a1b6b0d20d499b.jpg saved to cache
2026-03-30 08:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8561d9f2-eef1-58d9-b9b3-754ec7c3adda
2026-03-30 08:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6cc6cba90>
2026-03-30 08:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8561d9f2-eef1-58d9-b9b3-754ec7c3adda/8561d9f2-eef1-58d9-b9b3-754ec7c3adda_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F85%252Fd38573fbf3b26ea11b6f4d6fcc357de9%252Fpa%252FPH13121_d98a68ae34a6c5e81b67c2cf41ec2b5b.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_d98a68ae34a6c5e81b67c2cf41ec2b5b.jpg saved to cache
2026-03-30 08:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8561d9f2-eef1-58d9-b9b3-754ec7c3adda
2026-03-30 08:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7aa390>
2026-03-30 08:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8561d9f2-eef1-58d9-b9b3-754ec7c3adda/8561d9f2-eef1-58d9-b9b3-754ec7c3adda_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F85%252Fd38573fbf3b26ea11b6f4d6fcc357de9%252Fpa%252FPH13121_c442cc85fca36385d5dc16f35b5d9ad3.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_c442cc85fca36385d5dc16f35b5d9ad3.jpg saved to cache
2026-03-30 08:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8561d9f2-eef1-58d9-b9b3-754ec7c3adda
2026-03-30 08:31:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8561d9f2-eef1-58d9-b9b3-754ec7c3adda, skipping ID generation
2026-03-30 08:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8561d9f2-eef1-58d9-b9b3-754ec7c3adda with scrape type 1
2026-03-30 08:31:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8561d9f2-eef1-58d9-b9b3-754ec7c3adda sending to next pipeline
2026-03-30 08:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8561d9f2-eef1-58d9-b9b3-754ec7c3adda, identifier: PH13121
2026-03-30 08:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8561d9f2-eef1-58d9-b9b3-754ec7c3adda with identifier: PH13121
2026-03-30 08:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8561d9f2-eef1-58d9-b9b3-754ec7c3adda with identifier: PH13121
2026-03-30 08:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8561d9f2-eef1-58d9-b9b3-754ec7c3adda with identifier: PH13121 to the API
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_c442cc85fca36385d5dc16f35b5d9ad3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '0.7L',
 'engine_horse_power': 50,
 'expiration_date': '2026-03-31T15:57:41Z',
 'fuel_type': 'petrol',
 'id': '8561d9f2-eef1-58d9-b9b3-754ec7c3adda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH13121',
 'listing': 'auction',
 'location': 'BE, Oudenaarde',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 57963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8561d9f2-eef1-58d9-b9b3-754ec7c3adda/8561d9f2-eef1-58d9-b9b3-754ec7c3adda_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_8ba2631afd7be0e42e03be090fe7e350.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8561d9f2-eef1-58d9-b9b3-754ec7c3adda/8561d9f2-eef1-58d9-b9b3-754ec7c3adda_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_971cb28ac7d72652e739dfe0f79b3b49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8561d9f2-eef1-58d9-b9b3-754ec7c3adda/8561d9f2-eef1-58d9-b9b3-754ec7c3adda_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_a7b553c6ffae3aef45cebe70b19c6750.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8561d9f2-eef1-58d9-b9b3-754ec7c3adda/8561d9f2-eef1-58d9-b9b3-754ec7c3adda_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_898348e5455d8474e3a1b6b0d20d499b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8561d9f2-eef1-58d9-b9b3-754ec7c3adda/8561d9f2-eef1-58d9-b9b3-754ec7c3adda_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_d98a68ae34a6c5e81b67c2cf41ec2b5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8561d9f2-eef1-58d9-b9b3-754ec7c3adda/8561d9f2-eef1-58d9-b9b3-754ec7c3adda_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/85/d38573fbf3b26ea11b6f4d6fcc357de9/pa/PH13121_c442cc85fca36385d5dc16f35b5d9ad3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-02-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 0.7 Turbo Basis pure',
 'transmission': 'automatic',
 'trim': 'Basis pure',
 'year': 2006}
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH13121%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Saving data for PH13121: {'created_time': 1774859511.607475, 'last_price_update_time': 1774859511.607487, 'auction_closing_time': 1774972661.0}
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PH13121') HTTP/1.1" 204 0
2026-03-30 08:31:51 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1492 | hits on page: 40
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF75491%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for UF75491: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: ZP25114
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: FP22064
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: EL71552
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL71552%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for EL71552: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: SK78967
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK78967%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for SK78967: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: TG30379
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG30379%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for TG30379: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB21184%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for DB21184: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: LU53556
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: TT03576
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: EA40127
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA40127%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for EA40127: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: DF78239
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF78239%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for DF78239: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: CM14446
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: VE29498
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: BE62996
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE62996%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for BE62996: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: AM49333
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL91929%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for EL91929: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: FC05247
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: NC38410
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE91648%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for LE91648: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: ZZ00486
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ00486%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for ZZ00486: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: TX69988
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: HK94342
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: YK14398
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK14398%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for YK14398: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: FC68971
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC68971%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for FC68971: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: SL05027
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: TE49371
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE49371%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for TE49371: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: EK47235
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: SJ26894
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: VP06293
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: CC34063
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC34063%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for CC34063: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: DH17925
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: UX89863
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX89863%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for UX89863: 0
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: UX80051
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: MG99487
2026-03-30 08:31:51 [auto1.be] INFO: Found listing with ID: AJ87899
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ87899%27 HTTP/1.1" 200 None
2026-03-30 08:31:51 [auto1.be] INFO: Scrape type for AJ87899: 0
2026-03-30 08:31:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF38996> (referer: https://www.auto1.com/v1/car-details-view/UF38996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 380b9005-4b17-5e0a-ae17-a8f47a4edee9 with identifier: UF38996
2026-03-30 08:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9 with scrape type 1
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_eb2590752e0b703bd6454a7d59be0885.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_eb2590752e0b703bd6454a7d59be0885.jpg not downloaded yet
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_47464408c24b7201d3fc4ba9423716ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_47464408c24b7201d3fc4ba9423716ad.jpg not downloaded yet
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_c50c1caafc0eb4246205c79d44dadf67.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_c50c1caafc0eb4246205c79d44dadf67.jpg not downloaded yet
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_6736a9f17f89c1b2fe55b504d579c54f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_6736a9f17f89c1b2fe55b504d579c54f.jpg not downloaded yet
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_80e608fcb10a8749b4f9f92f3668ea82.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_80e608fcb10a8749b4f9f92f3668ea82.jpg not downloaded yet
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_30c8d76213bc6368a05caad80a8bdba8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_30c8d76213bc6368a05caad80a8bdba8.jpg not downloaded yet
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_e196de98ce3e6126557105bc0f477925.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_e196de98ce3e6126557105bc0f477925.jpg not downloaded yet
2026-03-30 08:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_eb2590752e0b703bd6454a7d59be0885.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_0c6b14bfdd214a58e0687583071a2a91.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_0c6b14bfdd214a58e0687583071a2a91.jpg not downloaded yet
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_7a834ed462359758ae2547572f3709ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_7a834ed462359758ae2547572f3709ef.jpg not downloaded yet
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_6a66e8bbb6439d96723543a5850fe496.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_6a66e8bbb6439d96723543a5850fe496.jpg not downloaded yet
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca6d5590>
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_eb2590752e0b703bd6454a7d59be0885.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_eb2590752e0b703bd6454a7d59be0885.jpg saved to cache
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9
2026-03-30 08:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_47464408c24b7201d3fc4ba9423716ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_6736a9f17f89c1b2fe55b504d579c54f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_c50c1caafc0eb4246205c79d44dadf67.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_30c8d76213bc6368a05caad80a8bdba8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_80e608fcb10a8749b4f9f92f3668ea82.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c950dbd0>
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_47464408c24b7201d3fc4ba9423716ad.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_47464408c24b7201d3fc4ba9423716ad.jpg saved to cache
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca733690>
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_6736a9f17f89c1b2fe55b504d579c54f.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_6736a9f17f89c1b2fe55b504d579c54f.jpg saved to cache
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9
2026-03-30 08:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_7a834ed462359758ae2547572f3709ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_0c6b14bfdd214a58e0687583071a2a91.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_e196de98ce3e6126557105bc0f477925.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_6a66e8bbb6439d96723543a5850fe496.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca7a8c90>
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_c50c1caafc0eb4246205c79d44dadf67.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_c50c1caafc0eb4246205c79d44dadf67.jpg saved to cache
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca8f8950>
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_30c8d76213bc6368a05caad80a8bdba8.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_30c8d76213bc6368a05caad80a8bdba8.jpg saved to cache
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c93e1150>
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_80e608fcb10a8749b4f9f92f3668ea82.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_80e608fcb10a8749b4f9f92f3668ea82.jpg saved to cache
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6ca8f9290>
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_7a834ed462359758ae2547572f3709ef.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_7a834ed462359758ae2547572f3709ef.jpg saved to cache
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c93e5410>
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_0c6b14bfdd214a58e0687583071a2a91.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_0c6b14bfdd214a58e0687583071a2a91.jpg saved to cache
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c95dfb50>
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_e196de98ce3e6126557105bc0f477925.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_e196de98ce3e6126557105bc0f477925.jpg saved to cache
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb6c9373650>
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F18%252F0d18d2f3d2915ee1b665ba99afd3593e%252Fpa%252FUF38996_6a66e8bbb6439d96723543a5850fe496.jpg') HTTP/1.1" 204 0
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_6a66e8bbb6439d96723543a5850fe496.jpg saved to cache
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9
2026-03-30 08:31:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 380b9005-4b17-5e0a-ae17-a8f47a4edee9, skipping ID generation
2026-03-30 08:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9 with scrape type 1
2026-03-30 08:31:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 380b9005-4b17-5e0a-ae17-a8f47a4edee9 sending to next pipeline
2026-03-30 08:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 380b9005-4b17-5e0a-ae17-a8f47a4edee9, identifier: UF38996
2026-03-30 08:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 380b9005-4b17-5e0a-ae17-a8f47a4edee9 with identifier: UF38996
2026-03-30 08:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 380b9005-4b17-5e0a-ae17-a8f47a4edee9 with identifier: UF38996
2026-03-30 08:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 380b9005-4b17-5e0a-ae17-a8f47a4edee9 with identifier: UF38996 to the API
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_6a66e8bbb6439d96723543a5850fe496.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Taxi',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:14:43Z',
 'fuel_type': 'hybrid',
 'id': '380b9005-4b17-5e0a-ae17-a8f47a4edee9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF38996',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 55313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_eb2590752e0b703bd6454a7d59be0885.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_47464408c24b7201d3fc4ba9423716ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_c50c1caafc0eb4246205c79d44dadf67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_6736a9f17f89c1b2fe55b504d579c54f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_80e608fcb10a8749b4f9f92f3668ea82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_30c8d76213bc6368a05caad80a8bdba8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_e196de98ce3e6126557105bc0f477925.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_0c6b14bfdd214a58e0687583071a2a91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_7a834ed462359758ae2547572f3709ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380b9005-4b17-5e0a-ae17-a8f47a4edee9/380b9005-4b17-5e0a-ae17-a8f47a4edee9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/18/0d18d2f3d2915ee1b665ba99afd3593e/pa/UF38996_6a66e8bbb6439d96723543a5850fe496.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda HR-V 1.5 i-MMD Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2022}
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF38996%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Saving data for UF38996: {'created_time': 1774859513.505024, 'last_price_update_time': 1774859513.505036, 'auction_closing_time': 1774970083.0}
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UF38996') HTTP/1.1" 204 0
2026-03-30 08:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:53 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1492 | hits on page: 40
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: RL01911
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL01911%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Scrape type for RL01911: 0
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: FG10633
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: KE27400
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV95971%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Scrape type for JV95971: 0
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Scrape type for SB67636: 0
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE14127%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Scrape type for CE14127: 0
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Scrape type for KA88762: 0
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Scrape type for GG74067: 0
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN37913%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Scrape type for HN37913: 0
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH43704%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Scrape type for NH43704: 0
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM15621%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Scrape type for XM15621: 0
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM14350%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Scrape type for FM14350: 0
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL66260%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Scrape type for WL66260: 0
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY63763%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Scrape type for FY63763: 0
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50133%27 HTTP/1.1" 200 None
2026-03-30 08:31:53 [auto1.be] INFO: Scrape type for CD50133: 0
2026-03-30 08:31:53 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-30 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ16034%27 HTTP/1.1" 200 None
2026-03-30 08:31:54 [auto1.be] INFO: Scrape type for SZ16034: 0
2026-03-30 08:31:54 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP25504%27 HTTP/1.1" 200 None
2026-03-30 08:31:54 [auto1.be] INFO: Scrape type for FP25504: 0
2026-03-30 08:31:54 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX88810%27 HTTP/1.1" 200 None
2026-03-30 08:31:54 [auto1.be] INFO: Scrape type for BX88810: 0
2026-03-30 08:31:54 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-30 08:31:54 [auto1.be] INFO: Scrape type for EJ45470: 0
2026-03-30 08:31:54 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-30 08:31:54 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ00027%27 HTTP/1.1" 200 None
2026-03-30 08:31:54 [auto1.be] INFO: Scrape type for EZ00027: 0
2026-03-30 08:31:54 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD85961%27 HTTP/1.1" 200 None
2026-03-30 08:31:54 [auto1.be] INFO: Scrape type for PD85961: 0
2026-03-30 08:31:54 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-30 08:31:54 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-30 08:31:54 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-30 08:31:54 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-30 08:31:54 [auto1.be] INFO: Scrape type for EA25293: 0
2026-03-30 08:31:54 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-30 08:31:54 [auto1.be] INFO: Scrape type for KE26750: 0
2026-03-30 08:31:54 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-30 08:31:54 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-30 08:31:54 [auto1.be] INFO: Scrape type for XU03064: 0
2026-03-30 08:31:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:55 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1492 | hits on page: 40
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for UX94260: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for JS18374: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX45109%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for TX45109: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for JD01885: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for GK88228: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for RP30975: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for DW61635: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for TV92859: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for XZ54371: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for GT11330: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for CX99155: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for LZ48262: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for HS59761: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for ML85388: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for RM46702: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for AJ68637: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for BD10300: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for ZS70359: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for SE23508: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-30 08:31:55 [auto1.be] INFO: Scrape type for WW99205: 0
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-30 08:31:55 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-30 08:31:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:56 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1492 | hits on page: 40
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for LK16000: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for WA10715: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for XN92471: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for CK14854: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for JS91211: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for EX56301: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for DL13581: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for HP15544: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for PB67516: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for XB95573: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for ND89972: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for LG37246: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB34577%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for FB34577: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for KP74596: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for BN63741: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for GL29646: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for ZG73435: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for RA46458: 0
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-30 08:31:56 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-30 08:31:56 [auto1.be] INFO: Scrape type for HP14917: 0
2026-03-30 08:31:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:58 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1492 | hits on page: 40
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for WK92284: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for GX61337: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for UL34611: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for MW76341: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for EZ55101: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for TH53375: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for LE66186: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for RH88749: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for RK42644: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for AP73624: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for DF44974: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for DW87206: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for NY99560: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for NC25574: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for ZM46816: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for NG50909: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for TU47744: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for GD11285: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for NG90127: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for CC17071: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for KH63709: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for YN02015: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for VW32861: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for PE83293: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for WA92632: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for RW14221: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for WV47829: 0
2026-03-30 08:31:58 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-30 08:31:58 [auto1.be] INFO: Scrape type for AK54797: 0
2026-03-30 08:31:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:31:59 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1492 | hits on page: 40
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for LK29098: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for DY69036: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for YG22909: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for BP14655: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for ND78338: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for CS90165: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for LA76788: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for HB19534: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for PL61351: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for MC44479: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for SC04496: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for XJ47711: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for LE58292: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for SE12861: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for DP96573: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for LJ91533: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for TY52799: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-30 08:31:59 [auto1.be] INFO: Scrape type for ZB59407: 0
2026-03-30 08:31:59 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-30 08:31:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:01 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1492 | hits on page: 40
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for NU46591: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for XM93272: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for CS76215: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for JK00802: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for WD81319: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for ZM54310: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for MZ83142: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for CA72484: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for XK61886: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for SD60477: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for YB47559: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for PT26763: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for DH81993: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for ST89131: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for PC96861: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for MB19665: 0
2026-03-30 08:32:01 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-30 08:32:01 [auto1.be] INFO: Scrape type for SJ78748: 0
2026-03-30 08:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:03 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1492 | hits on page: 40
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for UM90025: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for LW74134: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for WE68493: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for AM54260: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for KD31542: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for DW89258: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for AU32211: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for DB63111: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for TF03002: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for KK24955: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for BA13225: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for HY58683: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for NP23299: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for UA98228: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for VT00410: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for WJ68976: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for TH19224: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-30 08:32:03 [auto1.be] INFO: Scrape type for CS08088: 0
2026-03-30 08:32:03 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-30 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-30 08:32:04 [auto1.be] INFO: Scrape type for XE73160: 0
2026-03-30 08:32:04 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-30 08:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-30 08:32:04 [auto1.be] INFO: Scrape type for VH38978: 0
2026-03-30 08:32:04 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-30 08:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:05 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1492 | hits on page: 40
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for WH41445: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for CB86664: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for ZK51965: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for TT75307: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for EP09858: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for DH21315: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for EW63431: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for RG44645: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for DS23322: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for GW63299: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for JF41683: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for FT96499: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for XR84470: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for FL46625: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for AX12673: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for JH02802: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for GF63829: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for KG19380: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for HH24769: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for EP14144: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for JW58136: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for RM51088: 0
2026-03-30 08:32:05 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-30 08:32:05 [auto1.be] INFO: Scrape type for KW38150: 0
2026-03-30 08:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:06 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1492 | hits on page: 40
2026-03-30 08:32:06 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-30 08:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-30 08:32:06 [auto1.be] INFO: Scrape type for JC96921: 0
2026-03-30 08:32:06 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-30 08:32:06 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-30 08:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-30 08:32:06 [auto1.be] INFO: Scrape type for CS46874: 0
2026-03-30 08:32:06 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-30 08:32:06 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-30 08:32:06 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-30 08:32:06 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-30 08:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-30 08:32:06 [auto1.be] INFO: Scrape type for HG61894: 0
2026-03-30 08:32:06 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-30 08:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for RB98158: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for WA78577: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for BC49055: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for RX75304: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for DG02903: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for WU67286: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for LL08256: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for AV28567: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for WB95668: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for FS62191: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for WU43595: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for VF88831: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for RA11008: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for PS61885: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-30 08:32:07 [auto1.be] INFO: Scrape type for YW15851: 0
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-30 08:32:07 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-30 08:32:07 [scrapy.extensions.logstats] INFO: Crawled 91 pages (at 50 pages/min), scraped 114 items (at 55 items/min)
2026-03-30 08:32:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-30 08:32:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:09 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1492 | hits on page: 40
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL26167%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for XL26167: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for YJ00240: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for GF65026: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for HS49836: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for UX15937: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for RU19747: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for CS20047: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for MK30308: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for FA61625: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for RL24593: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for XV14848: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for DY20434: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for CH15764: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for AX58227: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for GG92230: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for XC97675: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for XZ27909: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for XH41981: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for SV23823: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for YC48670: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for MK11042: 0
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-30 08:32:09 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-30 08:32:09 [auto1.be] INFO: Scrape type for AX51995: 0
2026-03-30 08:32:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:10 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1492 | hits on page: 40
2026-03-30 08:32:10 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-30 08:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX30605%27 HTTP/1.1" 200 None
2026-03-30 08:32:10 [auto1.be] INFO: Scrape type for SX30605: 0
2026-03-30 08:32:10 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-30 08:32:10 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for ZJ26609: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for TH79553: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for ED70069: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for XE15288: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for MN41841: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for TV22564: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for UA82763: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for YX48939: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for LW38679: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for RW15578: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for UW21644: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ77172%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for MJ77172: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for RK68346: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for JX04101: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for SD15124: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for RR03336: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for PF95077: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-30 08:32:11 [auto1.be] INFO: Scrape type for WE56106: 0
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-30 08:32:11 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-30 08:32:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:12 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1492 | hits on page: 40
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-30 08:32:12 [auto1.be] INFO: Scrape type for ZP07177: 0
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-30 08:32:12 [auto1.be] INFO: Scrape type for FC28046: 0
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-30 08:32:12 [auto1.be] INFO: Scrape type for FP68376: 0
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-30 08:32:12 [auto1.be] INFO: Scrape type for AF71611: 0
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-30 08:32:12 [auto1.be] INFO: Scrape type for FG88533: 0
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-30 08:32:12 [auto1.be] INFO: Scrape type for ET09366: 0
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-30 08:32:12 [auto1.be] INFO: Scrape type for SR34780: 0
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-30 08:32:12 [auto1.be] INFO: Scrape type for JZ88652: 0
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-30 08:32:12 [auto1.be] INFO: Scrape type for UV91092: 0
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-30 08:32:12 [auto1.be] INFO: Scrape type for JX62848: 0
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-30 08:32:12 [auto1.be] INFO: Scrape type for HT09098: 0
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-30 08:32:12 [auto1.be] INFO: Scrape type for KC19835: 0
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-30 08:32:12 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-30 08:32:12 [auto1.be] INFO: Scrape type for GR78986: 0
2026-03-30 08:32:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:14 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1492 | hits on page: 40
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for RN56335: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for RF80171: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for DT24627: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for CH83928: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for BC69430: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for CR22525: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for CP91123: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for RB53949: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for XD36076: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for RK05604: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for WA39171: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for AL21659: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for ZH14429: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for UD97693: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for VM79296: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for YF30387: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for DY95002: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for HL95749: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-30 08:32:14 [auto1.be] INFO: Scrape type for SA79242: 0
2026-03-30 08:32:14 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-30 08:32:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:15 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1492 | hits on page: 40
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for WC10504: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for CE58685: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for YH98972: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for GN45273: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for AE23838: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for WD60187: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for MF96479: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for KF59500: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for ZT52703: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for GP69185: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for ZR52684: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for CN47453: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for KW15988: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for ZR23499: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for UT35373: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for MA06269: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for ZR56949: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for YU72813: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for CM40127: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for HT96077: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for UB84592: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-30 08:32:15 [auto1.be] INFO: Scrape type for LE55631: 0
2026-03-30 08:32:15 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-30 08:32:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:17 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1492 | hits on page: 40
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for KF52558: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for NM84060: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for TW64249: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for PY81659: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for UV50609: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for WK14396: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for RW49064: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for ZL81412: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC69840%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for KC69840: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for CS98471: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for ZR84759: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for WG89987: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for WC98842: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for TS87931: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for VM06685: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for SZ60181: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for UJ89543: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ97752%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for JZ97752: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for CG91643: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for SF38570: 0
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-30 08:32:17 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-30 08:32:17 [auto1.be] INFO: Scrape type for MS23670: 0
2026-03-30 08:32:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:18 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1492 | hits on page: 40
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for CU40853: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for PR31064: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for CE65833: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for VA87646: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for MJ08102: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for CF04837: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for TS87416: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for JM27578: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for YB94076: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for DF96327: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for MC94265: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for VP90118: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for PK93774: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for BT72678: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for TK06008: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for NM63028: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for GS48835: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for FA63464: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for YD21406: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for XJ95743: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for DB02418: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for XT36171: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for MC66522: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for ZK00678: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for HH62001: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for WF76478: 0
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-30 08:32:18 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-30 08:32:18 [auto1.be] INFO: Scrape type for SU72836: 0
2026-03-30 08:32:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:20 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1492 | hits on page: 40
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for ME81448: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for GA09150: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for JS25395: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for XC10139: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for RL32581: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for FY43318: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for FR80699: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for XT87195: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for KP16725: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for WP21428: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for XC64567: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for EX63844: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for VA07887: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for FJ79675: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for XT90325: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for CS46585: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-30 08:32:20 [auto1.be] INFO: Scrape type for CG39340: 0
2026-03-30 08:32:20 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-30 08:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-30 08:32:21 [auto1.be] INFO: Scrape type for LP39108: 0
2026-03-30 08:32:21 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-30 08:32:21 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-30 08:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-30 08:32:21 [auto1.be] INFO: Scrape type for LM00165: 0
2026-03-30 08:32:21 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-30 08:32:21 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-30 08:32:21 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-30 08:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-30 08:32:21 [auto1.be] INFO: Scrape type for SC36479: 0
2026-03-30 08:32:21 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-30 08:32:21 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-30 08:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-30 08:32:21 [auto1.be] INFO: Scrape type for TX85632: 0
2026-03-30 08:32:21 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-30 08:32:21 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-30 08:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-30 08:32:21 [auto1.be] INFO: Scrape type for CH34151: 0
2026-03-30 08:32:21 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-30 08:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-30 08:32:21 [auto1.be] INFO: Scrape type for VP78411: 0
2026-03-30 08:32:21 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-30 08:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-30 08:32:21 [auto1.be] INFO: Scrape type for DM43787: 0
2026-03-30 08:32:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:22 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1493 | hits on page: 40
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for DM43787: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for SA37733: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for ED59297: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for DU38710: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for YK80434: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for VZ63754: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for TU11660: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for LP07116: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for BK01349: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for AW74184: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for SC85120: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for BA37972: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for TW09601: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for TZ99758: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for DY28234: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for UU12218: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for PB25162: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for KU11213: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for PY12122: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for DC17534: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for WP69561: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for YS56392: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for VB04696: 0
2026-03-30 08:32:22 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-30 08:32:22 [auto1.be] INFO: Scrape type for RR89556: 0
2026-03-30 08:32:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:23 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1493 | hits on page: 40
2026-03-30 08:32:23 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-30 08:32:23 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-30 08:32:23 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-30 08:32:23 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-30 08:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-30 08:32:23 [auto1.be] INFO: Scrape type for SZ65946: 0
2026-03-30 08:32:23 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-30 08:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for FH97290: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for MV82025: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for WH33984: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for ET79377: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for UR44884: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for HM84114: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for FN16517: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for PR84870: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for WK50026: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for MK20825: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for YS48127: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for RF74485: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for MU18005: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for KV94769: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for ZC67013: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for ZK51287: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for JX00156: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for UN77217: 0
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-30 08:32:24 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-30 08:32:24 [auto1.be] INFO: Scrape type for FM00077: 0
2026-03-30 08:32:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:25 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1493 | hits on page: 40
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for NS73936: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for RK82839: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for LE69229: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for CN29269: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for HE95946: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for ZN76480: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for TR87241: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ08738%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for DJ08738: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for FN69818: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for XB17770: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for MV28568: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN22557%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for SN22557: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for FW88759: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS82481%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for PS82481: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for UU07035: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for WL68728: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for MR51068: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AZ39903%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for AZ39903: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for HB98543: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL83155%27 HTTP/1.1" 200 None
2026-03-30 08:32:25 [auto1.be] INFO: Scrape type for NL83155: 0
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-30 08:32:25 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-30 08:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF94112%27 HTTP/1.1" 200 None
2026-03-30 08:32:26 [auto1.be] INFO: Scrape type for PF94112: 0
2026-03-30 08:32:26 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-30 08:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT95399%27 HTTP/1.1" 200 None
2026-03-30 08:32:26 [auto1.be] INFO: Scrape type for XT95399: 0
2026-03-30 08:32:26 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-30 08:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT98676%27 HTTP/1.1" 200 None
2026-03-30 08:32:26 [auto1.be] INFO: Scrape type for NT98676: 0
2026-03-30 08:32:26 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-30 08:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA12378%27 HTTP/1.1" 200 None
2026-03-30 08:32:26 [auto1.be] INFO: Scrape type for ZA12378: 0
2026-03-30 08:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:27 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1493 | hits on page: 40
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ54867%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for FJ54867: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD88013%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for KD88013: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY44687%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for YY44687: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX66623%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for BX66623: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM24490%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for DM24490: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM87207%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for PM87207: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XW30503%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for XW30503: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE36464%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for UE36464: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER02883%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for ER02883: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT18059%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for HT18059: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE64709%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for PE64709: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM05640%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for ZM05640: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT01454%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for KT01454: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC59433%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for AC59433: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68229%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for GM68229: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK30146%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for LK30146: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA37218%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for UA37218: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ75648%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for NZ75648: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER91021%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for ER91021: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM88075%27 HTTP/1.1" 200 None
2026-03-30 08:32:27 [auto1.be] INFO: Scrape type for EM88075: 0
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-30 08:32:27 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-30 08:32:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:28 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1494 | hits on page: 40
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV16393%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for UV16393: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY92488%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for AY92488: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL22884%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for RL22884: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH35268%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for WH35268: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ29736%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for DZ29736: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN30582%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for ZN30582: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89604%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for DW89604: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB30712%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for JB30712: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK23104%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for XK23104: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG83875%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for SG83875: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM29446%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for UM29446: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS20349%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for XS20349: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA24587%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for TA24587: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM51411%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for MM51411: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM05161%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for EM05161: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: US61524
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP44577%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for DP44577: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU92863%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for KU92863: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU79591%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for XU79591: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM11563%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for LM11563: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26705%27 HTTP/1.1" 200 None
2026-03-30 08:32:28 [auto1.be] INFO: Scrape type for VZ26705: 0
2026-03-30 08:32:28 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-30 08:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW19918%27 HTTP/1.1" 200 None
2026-03-30 08:32:29 [auto1.be] INFO: Scrape type for GW19918: 0
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY14877%27 HTTP/1.1" 200 None
2026-03-30 08:32:29 [auto1.be] INFO: Scrape type for UY14877: 0
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN49517%27 HTTP/1.1" 200 None
2026-03-30 08:32:29 [auto1.be] INFO: Scrape type for GN49517: 0
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30988%27 HTTP/1.1" 200 None
2026-03-30 08:32:29 [auto1.be] INFO: Scrape type for BE30988: 0
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA99224%27 HTTP/1.1" 200 None
2026-03-30 08:32:29 [auto1.be] INFO: Scrape type for LA99224: 0
2026-03-30 08:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:29 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1494 | hits on page: 40
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ36560%27 HTTP/1.1" 200 None
2026-03-30 08:32:29 [auto1.be] INFO: Scrape type for GJ36560: 0
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER36240%27 HTTP/1.1" 200 None
2026-03-30 08:32:29 [auto1.be] INFO: Scrape type for ER36240: 0
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD86163%27 HTTP/1.1" 200 None
2026-03-30 08:32:29 [auto1.be] INFO: Scrape type for SD86163: 0
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT92464%27 HTTP/1.1" 200 None
2026-03-30 08:32:29 [auto1.be] INFO: Scrape type for BT92464: 0
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-30 08:32:29 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG93945%27 HTTP/1.1" 200 None
2026-03-30 08:32:30 [auto1.be] INFO: Scrape type for KG93945: 0
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ19751%27 HTTP/1.1" 200 None
2026-03-30 08:32:30 [auto1.be] INFO: Scrape type for HJ19751: 0
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ70860%27 HTTP/1.1" 200 None
2026-03-30 08:32:30 [auto1.be] INFO: Scrape type for JJ70860: 0
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR09444%27 HTTP/1.1" 200 None
2026-03-30 08:32:30 [auto1.be] INFO: Scrape type for JR09444: 0
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET82729%27 HTTP/1.1" 200 None
2026-03-30 08:32:30 [auto1.be] INFO: Scrape type for ET82729: 0
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL00392%27 HTTP/1.1" 200 None
2026-03-30 08:32:30 [auto1.be] INFO: Scrape type for HL00392: 0
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU29077%27 HTTP/1.1" 200 None
2026-03-30 08:32:30 [auto1.be] INFO: Scrape type for AU29077: 0
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL05782%27 HTTP/1.1" 200 None
2026-03-30 08:32:30 [auto1.be] INFO: Scrape type for FL05782: 0
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY27001%27 HTTP/1.1" 200 None
2026-03-30 08:32:30 [auto1.be] INFO: Scrape type for UY27001: 0
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM21252%27 HTTP/1.1" 200 None
2026-03-30 08:32:30 [auto1.be] INFO: Scrape type for CM21252: 0
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU85893%27 HTTP/1.1" 200 None
2026-03-30 08:32:30 [auto1.be] INFO: Scrape type for SU85893: 0
2026-03-30 08:32:30 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT20121%27 HTTP/1.1" 200 None
2026-03-30 08:32:30 [auto1.be] INFO: Scrape type for DT20121: 0
2026-03-30 08:32:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:39 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1494 | hits on page: 40
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM76060%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for VM76060: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TJ00131%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for TJ00131: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY36246%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for VY36246: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ04907%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for MJ04907: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG03175%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for YG03175: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UG65181%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for UG65181: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT35610%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for KT35610: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH80996%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for GH80996: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY24236%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for ZY24236: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ74713%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for ZZ74713: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD67660%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for XD67660: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT55223%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for DT55223: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL95031%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for EL95031: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX01518%27 HTTP/1.1" 200 None
2026-03-30 08:32:39 [auto1.be] INFO: Scrape type for UX01518: 0
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-30 08:32:39 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK14732%27 HTTP/1.1" 200 None
2026-03-30 08:32:40 [auto1.be] INFO: Scrape type for EK14732: 0
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR02836%27 HTTP/1.1" 200 None
2026-03-30 08:32:40 [auto1.be] INFO: Scrape type for UR02836: 0
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK01311%27 HTTP/1.1" 200 None
2026-03-30 08:32:40 [auto1.be] INFO: Scrape type for XK01311: 0
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED41371%27 HTTP/1.1" 200 None
2026-03-30 08:32:40 [auto1.be] INFO: Scrape type for ED41371: 0
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX51166%27 HTTP/1.1" 200 None
2026-03-30 08:32:40 [auto1.be] INFO: Scrape type for VX51166: 0
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD29807%27 HTTP/1.1" 200 None
2026-03-30 08:32:40 [auto1.be] INFO: Scrape type for BD29807: 0
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26009%27 HTTP/1.1" 200 None
2026-03-30 08:32:40 [auto1.be] INFO: Scrape type for ZJ26009: 0
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR36013%27 HTTP/1.1" 200 None
2026-03-30 08:32:40 [auto1.be] INFO: Scrape type for LR36013: 0
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-30 08:32:40 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-30 08:32:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:41 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1494 | hits on page: 40
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50404%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for TX50404: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR69689%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for HR69689: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC15884%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for FC15884: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX73156%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for KX73156: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ00073%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for SZ00073: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA73486%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for CA73486: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU74968%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for NU74968: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX14373%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for WX14373: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW60531%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for SW60531: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH65741%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for KH65741: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ51820%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for JJ51820: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV58665%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for CV58665: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE94103%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for NE94103: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC51689%27 HTTP/1.1" 200 None
2026-03-30 08:32:41 [auto1.be] INFO: Scrape type for RC51689: 0
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-30 08:32:41 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-30 08:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB41449%27 HTTP/1.1" 200 None
2026-03-30 08:32:42 [auto1.be] INFO: Scrape type for KB41449: 0
2026-03-30 08:32:42 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-30 08:32:42 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-30 08:32:42 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-30 08:32:42 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-30 08:32:42 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-30 08:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU94491%27 HTTP/1.1" 200 None
2026-03-30 08:32:42 [auto1.be] INFO: Scrape type for JU94491: 0
2026-03-30 08:32:42 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-30 08:32:42 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-30 08:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU93740%27 HTTP/1.1" 200 None
2026-03-30 08:32:42 [auto1.be] INFO: Scrape type for PU93740: 0
2026-03-30 08:32:42 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-30 08:32:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:43 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1494 | hits on page: 40
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG70738%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for XG70738: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV92885%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for GV92885: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV83163%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for DV83163: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF15006%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for AF15006: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY19882%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for JY19882: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ80953%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for JZ80953: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL44110%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for TL44110: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC31614%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for FC31614: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU06988%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for CU06988: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH04328%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for KH04328: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN32494%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for GN32494: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA84805%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for LA84805: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX31058%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for RX31058: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB55914%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for BB55914: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC67497%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for KC67497: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: US61346
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61346%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for US61346: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY12350%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for SY12350: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST29091%27 HTTP/1.1" 200 None
2026-03-30 08:32:43 [auto1.be] INFO: Scrape type for ST29091: 0
2026-03-30 08:32:43 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-30 08:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV57254%27 HTTP/1.1" 200 None
2026-03-30 08:32:44 [auto1.be] INFO: Scrape type for TV57254: 0
2026-03-30 08:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:46 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1494 | hits on page: 40
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF01360%27 HTTP/1.1" 200 None
2026-03-30 08:32:46 [auto1.be] INFO: Scrape type for RF01360: 0
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU14069%27 HTTP/1.1" 200 None
2026-03-30 08:32:46 [auto1.be] INFO: Scrape type for UU14069: 0
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78459%27 HTTP/1.1" 200 None
2026-03-30 08:32:46 [auto1.be] INFO: Scrape type for XG78459: 0
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25321%27 HTTP/1.1" 200 None
2026-03-30 08:32:46 [auto1.be] INFO: Scrape type for RC25321: 0
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ86935%27 HTTP/1.1" 200 None
2026-03-30 08:32:46 [auto1.be] INFO: Scrape type for YZ86935: 0
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB72565%27 HTTP/1.1" 200 None
2026-03-30 08:32:46 [auto1.be] INFO: Scrape type for XB72565: 0
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV46198%27 HTTP/1.1" 200 None
2026-03-30 08:32:46 [auto1.be] INFO: Scrape type for PV46198: 0
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU30240%27 HTTP/1.1" 200 None
2026-03-30 08:32:46 [auto1.be] INFO: Scrape type for RU30240: 0
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX22473%27 HTTP/1.1" 200 None
2026-03-30 08:32:46 [auto1.be] INFO: Scrape type for XX22473: 0
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA99172%27 HTTP/1.1" 200 None
2026-03-30 08:32:46 [auto1.be] INFO: Scrape type for YA99172: 0
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD03709%27 HTTP/1.1" 200 None
2026-03-30 08:32:46 [auto1.be] INFO: Scrape type for PD03709: 0
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ47401%27 HTTP/1.1" 200 None
2026-03-30 08:32:46 [auto1.be] INFO: Scrape type for HJ47401: 0
2026-03-30 08:32:46 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-30 08:32:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:47 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1494 | hits on page: 14
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY04920%27 HTTP/1.1" 200 None
2026-03-30 08:32:47 [auto1.be] INFO: Scrape type for WY04920: 0
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG64643%27 HTTP/1.1" 200 None
2026-03-30 08:32:47 [auto1.be] INFO: Scrape type for PG64643: 0
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV20794%27 HTTP/1.1" 200 None
2026-03-30 08:32:47 [auto1.be] INFO: Scrape type for PV20794: 0
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ57770%27 HTTP/1.1" 200 None
2026-03-30 08:32:47 [auto1.be] INFO: Scrape type for SJ57770: 0
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-30 08:32:47 [auto1.be] INFO: Scrape type for AB83336: 0
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR34349%27 HTTP/1.1" 200 None
2026-03-30 08:32:47 [auto1.be] INFO: Scrape type for MR34349: 0
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-30 08:32:47 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-30 08:32:47 [auto1.be] INFO: Scrape type for UW48636: 0
2026-03-30 08:32:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:32:48 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1494 | hits on page: 0
2026-03-30 08:32:48 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 08:32:48 [auto1.be] INFO: auto1.be Batch config: batch 1/2
2026-03-30 08:32:48 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 558, <ScrapeType.BATCH_SKIPPED: 5>: 536}
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20last_price_update_time%20lt%201774427568 HTTP/1.1" 200 None
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AG54530') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BF59429') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BG54719') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BM34289') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BM88637') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BN85493') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BS25609') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CF71663') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DC49978') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ79108') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EC23053') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ED95860') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EH26295') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EJ53112') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ER21490') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GD71544') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GZ98500') HTTP/1.1" 204 0
2026-03-30 08:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HH15282') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HL30387') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HR59519') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JC01519') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JT82815') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KD43188') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KP67280') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KR66982') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LF09311') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LG67698') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LK42331') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LS84726') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LV29435') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LY74643') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MA32333') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ML59136') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MT57296') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MU29688') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MV78698') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MW08059') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ43468') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ59473') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NN61566') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NU77681') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NV08431') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NW16503') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PH79419') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PK92970') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PL25871') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PM43145') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RA83034') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RB43129') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RC92286') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RK21262') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SB33640') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SR17020') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ST22647') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SW81748') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ83528') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TE44620') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TH92795') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TL11462') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TV80493') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TW73932') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UL29065') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UU50204') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UV57765') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UX77597') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UZ51574') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VF64295') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VK49547') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VP07407') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VU46096') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VW16372') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VY98416') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WH97602') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XD92545') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XG33358') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XU98741') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XW82749') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC57975') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZD65407') HTTP/1.1" 204 0
2026-03-30 08:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ71441') HTTP/1.1" 204 0
2026-03-30 08:32:49 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (114 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_25_2026-03-30T08_30_00.jl
2026-03-30 08:32:49 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 480887,
 'downloader/request_count': 260,
 'downloader/request_method_count/GET': 219,
 'downloader/request_method_count/POST': 41,
 'downloader/response_bytes': 47411151,
 'downloader/response_count': 260,
 'downloader/response_status_count/200': 260,
 'dupefilter/filtered': 9,
 'elapsed_time_seconds': 162.682808,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 8, 32, 49, 638102, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 114,
 'log_count/DEBUG': 4126,
 'log_count/INFO': 4564,
 'memusage/max': 190865408,
 'memusage/startup': 149602304,
 'photo_download_count': 149,
 'request_depth_max': 42,
 'response_received_count': 111,
 'scheduler/dequeued': 260,
 'scheduler/dequeued/memory': 260,
 'scheduler/enqueued': 260,
 'scheduler/enqueued/memory': 260,
 'scrape_type/batch_skipped': 759,
 'scrape_type/new': 34,
 'scrape_type/price_update': 80,
 'scrape_type/skipped': 652,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 111,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 4.823722303907914,
 'scrapy-zyte-api/mean_response_seconds': 4.890591273768091,
 'scrapy-zyte-api/processed': 111,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 111,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 110,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 111,
 'scrapy-zyte-api/request_args/httpRequestBody': 41,
 'scrapy-zyte-api/request_args/httpRequestMethod': 41,
 'scrapy-zyte-api/request_args/httpResponseBody': 111,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 111,
 'scrapy-zyte-api/request_args/sessionContext': 111,
 'scrapy-zyte-api/request_args/url': 111,
 'scrapy-zyte-api/status_codes/200': 111,
 'scrapy-zyte-api/success': 111,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1534,
 'source/total_available': 1494,
 'start_time': datetime.datetime(2026, 3, 30, 8, 30, 6, 955294, tzinfo=datetime.timezone.utc)}
2026-03-30 08:32:49 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 08:32:49 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb6cc633990>
2026-03-30 08:32:49 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb6cc7dfc50>